vm-test-run-nixbot-gitlab
x86_64-linux.nixbot-gitlab
· build #115
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 13)11gitlab # Formatting '/build/vm-state-gitlab/tmp.3z3iwBxVTU', fmt=raw size=107374182412gitlab # mke2fs 1.47.3 (8-Jul-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: 6ffa7db4-8ead-4906-b189-868e6199a67416(finished: start all VMs, in 35.91 seconds)17gitlab # Superblock backups stored on blocks:18gitlab: waiting for unit setup-gitlab.service19gitlab # 32768, 98304, 163840, 22937620gitlab: waiting for the VM to finish booting21gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... ok45gitlab # [ 0.000000] Linux version 6.18.34 (nixbld@localhost) (gcc (GCC) 15.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Jun 1 15:51:08 UTC 202646gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c8naaw9zklfrairqn6azrkxflp57y6li-nixos-system-gitlab-test/init regInfo=/nix/store/qj1z7mjq1bm7xvhjs792wvd8ms73ha77-closure-info/registration console=ttyS0,115200n8 console=tty047gitlab # [ 0.000000] BIOS-provided physical RAM map:48gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable49gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved51gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved55gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable56gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved57gitlab # [ 0.000000] NX (Execute Disable) protection: active58gitlab # [ 0.000000] APIC: Static calls initialized59gitlab # [ 0.000000] SMBIOS 2.8 present.60gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201461gitlab # [ 0.000000] DMI: Memory slots populated: 1/162gitlab # [ 0.000000] Hypervisor detected: KVM63gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000064gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0065gitlab # [ 0.000000] kvm-clock: using sched offset of 481377797 cycles66gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns67gitlab # [ 0.000005] tsc: Detected 2400.010 MHz processor68gitlab # [ 0.000811] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000069gitlab # [ 0.000847] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs70gitlab # [ 0.000850] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT71gitlab # [ 0.000902] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000072gitlab # [ 0.002749] found SMP MP-table at [mem 0x000f5470-0x000f547f]73gitlab # [ 0.002765] Using GB pages for direct mapping74gitlab # [ 0.002874] RAMDISK: [mem 0xbe4e0000-0xbffcffff]75gitlab # [ 0.002880] ACPI: Early table checksum verification disabled76gitlab # [ 0.002883] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )77gitlab # [ 0.002887] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002891] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002898] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)80gitlab # [ 0.002900] ACPI: FACS 0x00000000BFFE0000 00004081gitlab # [ 0.002901] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002903] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002904] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)84gitlab # [ 0.002906] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]85gitlab # [ 0.002907] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]86gitlab # [ 0.002907] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]87gitlab # [ 0.002908] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]88gitlab # [ 0.002908] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]89gitlab # [ 0.002909] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]90gitlab # [ 0.003387] No NUMA configuration found91gitlab # [ 0.003389] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]92gitlab # [ 0.003392] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]93gitlab # [ 0.005915] Zone ranges:94gitlab # [ 0.005916] DMA [mem 0x0000000000001000-0x0000000000ffffff]95gitlab # [ 0.005917] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]96gitlab # [ 0.005919] Normal [mem 0x0000000100000000-0x00000001bfffffff]97gitlab # [ 0.005920] Device empty98gitlab # [ 0.005920] Movable zone start for each node99gitlab # [ 0.005921] Early memory node ranges100gitlab # [ 0.005922] node 0: [mem 0x0000000000001000-0x000000000009efff]101gitlab # [ 0.005923] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]102gitlab # [ 0.005924] node 0: [mem 0x0000000100000000-0x00000001bfffffff]103gitlab # [ 0.005925] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]104gitlab # [ 0.005944] On node 0, zone DMA: 1 pages in unavailable ranges105gitlab # [ 0.006211] On node 0, zone DMA: 97 pages in unavailable ranges106gitlab # [ 0.114568] On node 0, zone Normal: 40 pages in unavailable ranges107gitlab # [ 0.115587] ACPI: PM-Timer IO Port: 0x608108gitlab # [ 0.115605] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])109gitlab # [ 0.115647] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23110gitlab # [ 0.115650] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)111gitlab # [ 0.115651] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)112gitlab # [ 0.115652] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)113gitlab # [ 0.115654] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)114gitlab # [ 0.115654] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)115gitlab # [ 0.115657] ACPI: Using ACPI (MADT) for SMP configuration information116gitlab # [ 0.115658] ACPI: HPET id: 0x8086a201 base: 0xfed00000117gitlab # [ 0.115665] TSC deadline timer available118gitlab # [ 0.115669] CPU topo: Max. logical packages: 1119gitlab # [ 0.115670] CPU topo: Max. logical dies: 1120gitlab # [ 0.115671] CPU topo: Max. dies per package: 1121gitlab # [ 0.115674] CPU topo: Max. threads per core: 1122gitlab # [ 0.115674] CPU topo: Num. cores per package: 4123gitlab # [ 0.115675] CPU topo: Num. threads per package: 4124gitlab # [ 0.115675] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs125gitlab # [ 0.115702] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()126gitlab # [ 0.115722] kvm-guest: KVM setup pv remote TLB flush127gitlab # [ 0.115725] kvm-guest: setup PV sched yield128gitlab # [ 0.115745] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]129gitlab # [ 0.115746] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]130gitlab # [ 0.115747] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]131gitlab # [ 0.115749] [mem 0xc0000000-0xfeffbfff] available for PCI devices132gitlab # [ 0.115750] Booting paravirtualized kernel on KVM133gitlab # [ 0.115754] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns134gitlab # [ 0.120228] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1135gitlab # [ 0.122406] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288136gitlab # [ 0.122454] kvm-guest: PV spinlocks enabled137gitlab # [ 0.122455] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)138gitlab # [ 0.122458] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c8naaw9zklfrairqn6azrkxflp57y6li-nixos-system-gitlab-test/init regInfo=/nix/store/qj1z7mjq1bm7xvhjs792wvd8ms73ha77-closure-info/registration console=ttyS0,115200n8 console=tty0139gitlab # [ 0.122557] Unknown kernel command line parameters "regInfo=/nix/store/qj1z7mjq1bm7xvhjs792wvd8ms73ha77-closure-info/registration", will be passed to user space.140gitlab # [ 0.122569] random: crng init done141gitlab # [ 0.122570] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes142gitlab # [ 0.131174] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)143gitlab # [ 0.135535] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)144gitlab # [ 0.135607] software IO TLB: area num 4.145gitlab # [ 0.208101] Fallback order for Node 0: 0146gitlab # [ 0.208109] Built 1 zonelists, mobility grouping on. Total pages: 1572726147gitlab # [ 0.208111] Policy zone: Normal148gitlab # [ 0.210608] mem auto-init: stack:all(zero), heap alloc:on, heap free:off149gitlab # [ 0.220205] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1150gitlab # [ 0.233483] allocated 12582912 bytes of page_ext151gitlab # [ 0.243739] ftrace: allocating 48565 entries in 192 pages152gitlab # [ 0.243741] ftrace: allocated 192 pages with 2 groups153gitlab # [ 0.244586] Dynamic Preempt: lazy154gitlab # [ 0.244722] rcu: Preemptible hierarchical RCU implementation.155gitlab # [ 0.244723] rcu: RCU event tracing is enabled.156gitlab # [ 0.244724] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.157gitlab # [ 0.244725] Trampoline variant of Tasks RCU enabled.158gitlab # [ 0.244726] Rude variant of Tasks RCU enabled.159gitlab # [ 0.244726] Tracing variant of Tasks RCU enabled.160gitlab # [ 0.244727] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.161gitlab # [ 0.244728] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4162gitlab # [ 0.244747] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.244749] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.244750] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.165gitlab # [ 0.249132] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16166gitlab # [ 0.249421] rcu: srcu_init: Setting srcu_struct sizes based on contention.167gitlab # [ 0.249543] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.256762] Console: colour VGA+ 80x25169gitlab # [ 0.256766] printk: legacy console [tty0] enabled170gitlab # [ 0.300284] printk: legacy console [ttyS0] enabled171gitlab # [ 0.493360] ACPI: Core revision 20250807172gitlab # [ 0.494909] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.497709] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.499426] x2apic enabled175gitlab # [ 0.500647] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.502355] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.504530] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.507219] kvm-guest: setup PV IPIs179gitlab # [ 0.509507] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.511296] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns181gitlab # [ 0.514335] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400010)182gitlab # [ 0.516452] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.517470] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.518334] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.519338] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.521334] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.522334] Transient Scheduler Attacks: Mitigation: Clear CPU buffers188gitlab # [ 0.524333] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.526333] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.527333] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.528340] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier192gitlab # [ 0.530334] active return thunk: srso_alias_return_thunk193gitlab # [ 0.531362] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'194gitlab # [ 0.532333] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'195gitlab # [ 0.533333] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'196gitlab # [ 0.534333] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'197gitlab # [ 0.536333] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'198gitlab # [ 0.538333] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'199gitlab # [ 0.539333] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'200gitlab # [ 0.540333] x86/fpu: Supporting XSAVE feature 0x800: 'Control-flow User registers'201gitlab # [ 0.542333] x86/fpu: Supporting XSAVE feature 0x1000: 'Control-flow Kernel registers (KVM only)'202gitlab # [ 0.543334] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256203gitlab # [ 0.544333] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64204gitlab # [ 0.545333] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512205gitlab # [ 0.546333] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024206gitlab # [ 0.548333] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8207gitlab # [ 0.550333] x86/fpu: xstate_offset[11]: 2440, xstate_sizes[11]: 16208gitlab # [ 0.551333] x86/fpu: xstate_offset[12]: 2456, xstate_sizes[12]: 24209gitlab # [ 0.552333] x86/fpu: Enabled xstate features 0x1ae7, context size is 2480 bytes, using 'compacted' format.210gitlab # [ 0.582856] Freeing SMP alternatives memory: 44K211gitlab # [ 0.583336] pid_max: default: 32768 minimum: 301212gitlab # [ 0.585440] LSM: initializing lsm=capability,landlock,yama,bpf,ima213gitlab # [ 0.586438] landlock: Up and running.214gitlab # [ 0.587334] Yama: becoming mindful.215gitlab # [ 0.588543] LSM support for eBPF active216gitlab # [ 0.590554] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)217gitlab # [ 0.591479] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)218gitlab # [ 0.595520] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)219gitlab # [ 0.596930] Performance Events: Fam17h+ core perfctr, AMD PMU driver.220gitlab # [ 0.597344] ... version: 2221gitlab # [ 0.598335] ... bit width: 48222gitlab # [ 0.599341] ... generic counters: 6223gitlab # [ 0.600335] ... generic bitmap: 000000000000003f224gitlab # [ 0.601335] ... fixed-purpose counters: 0225gitlab # [ 0.602335] ... fixed-purpose bitmap: 0000000000000000226gitlab # [ 0.603335] ... value mask: 0000ffffffffffff227gitlab # [ 0.604335] ... max period: 00007fffffffffff228gitlab # [ 0.605335] ... global_ctrl mask: 000000000000003f229gitlab # [ 0.606468] signal: max sigframe size: 3376230gitlab # [ 0.607462] rcu: Hierarchical SRCU implementation.231gitlab # [ 0.608339] rcu: Max phase no-delay instances is 400.232gitlab # [ 0.609533] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level233gitlab # [ 0.614968] smp: Bringing up secondary CPUs ...234gitlab # [ 0.615776] smpboot: x86: Booting SMP configuration:235gitlab # [ 0.616339] .... node #0, CPUs: #1 #2 #3236gitlab # [ 0.621369] smp: Brought up 1 node, 4 CPUs237gitlab # [ 0.623338] smpboot: Total of 4 processors activated (19200.08 BogoMIPS)238gitlab # [ 0.624863] Memory: 6013440K/6290904K available (17098K kernel code, 2721K rwdata, 13520K rodata, 3644K init, 3008K bss, 258300K reserved, 0K cma-reserved)239gitlab # [ 0.627333] devtmpfs: initialized240gitlab # [ 0.628591] x86/mm: Memory block size: 128MB241gitlab # [ 0.632394] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns242gitlab # [ 0.633383] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)243gitlab # [ 0.634419] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).244gitlab # [ 0.635454] pinctrl core: initialized pinctrl subsystem245gitlab # [ 0.636678] PM: RTC time: 10:53:54, date: 2026-07-06246gitlab # [ 0.640810] NET: Registered PF_NETLINK/PF_ROUTE protocol family247gitlab # [ 0.642748] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations248gitlab # [ 0.643407] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations249gitlab # [ 0.645515] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations250gitlab # [ 0.646352] audit: initializing netlink subsys (disabled)251gitlab # [ 0.647546] audit: type=2000 audit(1783335234.688:1): state=initialized audit_enabled=0 res=1252gitlab # [ 0.647669] thermal_sys: Registered thermal governor 'fair_share'253gitlab # [ 0.649336] thermal_sys: Registered thermal governor 'bang_bang'254gitlab # [ 0.650336] thermal_sys: Registered thermal governor 'step_wise'255gitlab # [ 0.651336] thermal_sys: Registered thermal governor 'user_space'256gitlab # [ 0.652336] thermal_sys: Registered thermal governor 'power_allocator'257gitlab # [ 0.653357] cpuidle: using governor menu258gitlab # [ 0.656587] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5259gitlab # [ 0.657668] PCI: Using configuration type 1 for base access260gitlab # [ 0.658336] PCI: Using configuration type 1 for extended access261gitlab # [ 0.659545] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.262gitlab # [ 0.661484] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages263gitlab # [ 0.662336] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page264gitlab # [ 0.663337] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages265gitlab # [ 0.664336] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page266gitlab # [ 0.669255] ACPI: Added _OSI(Module Device)267gitlab # [ 0.672345] ACPI: Added _OSI(Processor Device)268gitlab # [ 0.676344] ACPI: Added _OSI(Processor Aggregator Device)269gitlab # [ 0.685265] ACPI: 1 ACPI AML tables successfully acquired and loaded270gitlab # [ 0.696533] ACPI: Interpreter enabled271gitlab # [ 0.699490] ACPI: PM: (supports S0 S3 S4 S5)272gitlab # [ 0.703349] ACPI: Using IOAPIC for interrupt routing273gitlab # [ 0.707637] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug274gitlab # [ 0.710336] PCI: Using E820 reservations for host bridge windows275gitlab # [ 0.712596] ACPI: Enabled 2 GPEs in block 00 to 0F276gitlab # [ 0.719711] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])277gitlab # [ 0.723355] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]278gitlab # [ 0.729423] acpiphp: Slot [3] registered279gitlab # [ 0.730408] acpiphp: Slot [4] registered280gitlab # [ 0.731404] acpiphp: Slot [5] registered281gitlab # [ 0.733423] acpiphp: Slot [6] registered282gitlab # [ 0.734399] acpiphp: Slot [7] registered283gitlab # [ 0.736460] acpiphp: Slot [8] registered284gitlab # [ 0.737405] acpiphp: Slot [9] registered285gitlab # [ 0.738435] acpiphp: Slot [10] registered286gitlab # [ 0.740409] acpiphp: Slot [11] registered287gitlab # [ 0.741404] acpiphp: Slot [12] registered288gitlab # [ 0.742451] acpiphp: Slot [13] registered289gitlab # [ 0.744376] acpiphp: Slot [14] registered290gitlab # [ 0.745375] acpiphp: Slot [15] registered291gitlab # [ 0.747377] acpiphp: Slot [16] registered292gitlab # [ 0.748391] acpiphp: Slot [17] registered293gitlab # [ 0.749378] acpiphp: Slot [18] registered294gitlab # [ 0.751374] acpiphp: Slot [19] registered295gitlab # [ 0.752375] acpiphp: Slot [20] registered296gitlab # [ 0.753404] acpiphp: Slot [21] registered297gitlab # [ 0.755376] acpiphp: Slot [22] registered298gitlab # [ 0.756373] acpiphp: Slot [23] registered299gitlab # [ 0.757376] acpiphp: Slot [24] registered300gitlab # [ 0.759398] acpiphp: Slot [25] registered301gitlab # [ 0.760374] acpiphp: Slot [26] registered302gitlab # [ 0.762462] acpiphp: Slot [27] registered303gitlab # [ 0.763375] acpiphp: Slot [28] registered304gitlab # [ 0.764373] acpiphp: Slot [29] registered305gitlab # [ 0.766390] acpiphp: Slot [30] registered306gitlab # [ 0.768438] acpiphp: Slot [31] registered307gitlab # [ 0.771504] PCI host bridge to bus 0000:00308gitlab # [ 0.775398] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]309gitlab # [ 0.780349] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]310gitlab # [ 0.784348] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]311gitlab # [ 0.790348] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]312gitlab # [ 0.795349] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]313gitlab # [ 0.800377] pci_bus 0000:00: root bus resource [bus 00-ff]314gitlab # [ 0.804472] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint315gitlab # [ 0.811330] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint316gitlab # [ 0.816284] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint317gitlab # [ 0.821425] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]318gitlab # [ 0.822402] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk319gitlab # [ 0.824345] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk320gitlab # [ 0.826337] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk321gitlab # [ 0.828337] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk322gitlab # [ 0.832366] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint323gitlab # [ 0.842506] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]324gitlab # [ 0.849793] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint325gitlab # [ 0.857108] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI326gitlab # [ 0.863386] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB327gitlab # [ 0.868524] pci 0000:00:01.3: quirk_piix4_acpi+0x0/0x180 took 11718 usecs328gitlab # [ 0.875322] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint329gitlab # [ 0.896504] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]330gitlab # [ 0.900396] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]331gitlab # [ 0.904444] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]332gitlab # [ 0.907779] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]333gitlab # [ 0.934352] pci 0000:00:02.0: pci_fixup_video+0x0/0x100 took 25390 usecs334gitlab # [ 0.941023] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint335gitlab # [ 0.950377] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]336gitlab # [ 0.951350] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]337gitlab # [ 0.953388] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]338gitlab # [ 0.955350] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]339gitlab # [ 0.959549] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint340gitlab # [ 0.965405] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]341gitlab # [ 0.967359] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]342gitlab # [ 0.971480] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]343gitlab # [ 0.983659] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint344gitlab # [ 0.997383] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]345gitlab # [ 1.001387] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]346gitlab # [ 1.006486] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]347gitlab # [ 1.016069] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint348gitlab # [ 1.027381] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]349gitlab # [ 1.029410] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]350gitlab # [ 1.034483] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]351gitlab # [ 1.044971] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint352gitlab # [ 1.059390] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]353gitlab # [ 1.064392] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]354gitlab # [ 1.068475] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]355gitlab # [ 1.079598] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint356gitlab # [ 1.093381] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]357gitlab # [ 1.095356] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]358gitlab # [ 1.097392] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]359gitlab # [ 1.105534] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint360gitlab # [ 1.119380] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]361gitlab # [ 1.123380] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]362gitlab # [ 1.127473] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]363gitlab # [ 1.133380] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]364gitlab # [ 1.142408] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint365gitlab # [ 1.151394] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]366gitlab # [ 1.155445] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]367gitlab # [ 1.163350] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint368gitlab # [ 1.168389] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]369gitlab # [ 1.171381] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]370gitlab # [ 1.175476] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]371gitlab # [ 1.186597] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint372gitlab # [ 1.199381] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]373gitlab # [ 1.203381] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]374gitlab # [ 1.207476] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]375gitlab # [ 1.226779] ACPI: PCI: Interrupt link LNKA configured for IRQ 10376gitlab # [ 1.229567] ACPI: PCI: Interrupt link LNKB configured for IRQ 10377gitlab # [ 1.230536] ACPI: PCI: Interrupt link LNKC configured for IRQ 11378gitlab # [ 1.232664] ACPI: PCI: Interrupt link LNKD configured for IRQ 11379gitlab # [ 1.235448] ACPI: PCI: Interrupt link LNKS configured for IRQ 9380gitlab # [ 1.240406] iommu: Default domain type: Translated381gitlab # [ 1.243343] iommu: DMA domain TLB invalidation policy: lazy mode382gitlab # [ 1.249565] ACPI: bus type USB registered383gitlab # [ 1.252516] usbcore: registered new interface driver usbfs384gitlab # [ 1.256426] usbcore: registered new interface driver hub385gitlab # [ 1.260379] usbcore: registered new device driver usb386gitlab # [ 1.267296] NetLabel: Initializing387gitlab # [ 1.269340] NetLabel: domain hash size = 128388gitlab # [ 1.271340] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO389gitlab # [ 1.274511] NetLabel: unlabeled traffic allowed by default390gitlab # [ 1.278367] PCI: Using ACPI for IRQ routing391gitlab # [ 1.282504] pci 0000:00:02.0: vgaarb: setting as boot VGA device392gitlab # [ 1.283330] pci 0000:00:02.0: vgaarb: bridge control possible393gitlab # [ 1.283330] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none394gitlab # [ 1.289342] vgaarb: loaded395gitlab # [ 1.290471] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0396gitlab # [ 1.292336] hpet0: 3 comparators, 64-bit 100.000000 MHz counter397gitlab # [ 1.296458] clocksource: Switched to clocksource kvm-clock398gitlab # [ 1.298771] VFS: Disk quotas dquot_6.6.0399gitlab # [ 1.300102] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)400gitlab # [ 1.302573] pnp: PnP ACPI init401gitlab # [ 1.304282] pnp: PnP ACPI: found 6 devices402gitlab # [ 1.317154] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns403gitlab # [ 1.323573] clocksource: Switched to clocksource acpi_pm404gitlab # [ 1.328186] NET: Registered PF_INET protocol family405gitlab # [ 1.335355] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)406gitlab # [ 1.371525] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)407gitlab # [ 1.374107] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)408gitlab # [ 1.376472] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)409gitlab # [ 1.381416] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)410gitlab # [ 1.383651] TCP: Hash tables configured (established 65536 bind 65536)411gitlab # [ 1.385741] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)412gitlab # [ 1.388033] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)413gitlab # [ 1.390043] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)414gitlab # [ 1.392281] NET: Registered PF_UNIX/PF_LOCAL protocol family415gitlab # [ 1.394005] NET: Registered PF_XDP protocol family416gitlab # [ 1.395491] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]417gitlab # [ 1.397287] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]418gitlab # [ 1.399106] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]419gitlab # [ 1.401094] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]420gitlab # [ 1.403098] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]421gitlab # [ 1.405373] pci 0000:00:01.0: PIIX3: Enabling Passive Release422gitlab # [ 1.407123] pci 0000:00:00.0: Limiting direct PCI/PCI transfers423gitlab # [ 1.410472] ACPI: \_SB_.LNKD: Enabled at IRQ 11424gitlab # [ 1.414054] PCI: CLS 0 bytes, default 64425gitlab # [ 1.415434] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)426gitlab # [ 1.416318] Trying to unpack rootfs image as initramfs...427gitlab # [ 1.417325] software IO TLB: mapped [mem 0x00000000ba4e0000-0x00000000be4e0000] (64MB)428gitlab # [ 1.417461] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns429gitlab # [ 1.446340] Initialise system trusted keyrings430gitlab # [ 1.448192] workingset: timestamp_bits=40 max_order=21 bucket_order=0431gitlab # [ 1.478568] Key type asymmetric registered432gitlab # [ 1.481229] Asymmetric key parser 'x509' registered433gitlab # [ 1.484283] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)434gitlab # [ 1.489319] io scheduler mq-deadline registered435gitlab # [ 1.493014] io scheduler kyber registered436gitlab # [ 1.503548] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled437gitlab # [ 1.509301] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A438gitlab # [ 1.518864] Linux agpgart interface v0.103439gitlab # [ 1.522280] ACPI: bus type drm_connector registered440gitlab # [ 1.532145] usbcore: registered new interface driver usbserial_generic441gitlab # [ 1.537216] usbserial: USB Serial support registered for generic442gitlab # [ 1.541746] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.443gitlab # [ 1.541746] Please enable it if your BIOS has the CPPC option.444gitlab # [ 1.551536] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled445gitlab # [ 1.557424] drop_monitor: Initializing network drop monitor service446gitlab # [ 1.562390] NET: Registered PF_INET6 protocol family447gitlab # [ 1.568228] Segment Routing with IPv6448gitlab # [ 1.571090] In-situ OAM (IOAM) with IPv6449gitlab # [ 1.576496] IPI shorthand broadcast: enabled450gitlab # [ 1.589447] sched_clock: Marking stable (1336077306, 252897987)->(1673946665, -84971372)451gitlab # [ 1.596674] registered taskstats version 1452gitlab # [ 1.601103] Loading compiled-in X.509 certificates453gitlab # [ 1.623680] Demotion targets for Node 0: null454gitlab # [ 1.625629] Key type .fscrypt registered455gitlab # [ 1.626873] Key type fscrypt-provisioning registered456gitlab # [ 1.628546] ima: No TPM chip found, activating TPM-bypass!457gitlab # [ 1.630185] ima: Allocated hash algorithm: sha1458gitlab # [ 1.631617] ima: No architecture policies found459gitlab # [ 1.633486] PM: Magic number: 2:854:880460gitlab # [ 1.635875] RAS: Correctable Errors collector initialized.461gitlab # [ 1.641248] clk: Disabling unused clocks462gitlab # [ 1.642494] PM: genpd: Disabling unused power domains463gitlab # [ 1.729588] Freeing initrd memory: 27584K464gitlab # [ 1.738528] Freeing unused decrypted memory: 2028K465gitlab # [ 1.747421] Freeing unused kernel image (initmem) memory: 3644K466gitlab # [ 1.752180] Write protecting the kernel read-only data: 32768k467gitlab # [ 1.759691] Freeing unused kernel image (text/rodata gap) memory: 1332K468gitlab # [ 1.766169] Freeing unused kernel image (rodata/data gap) memory: 816K469gitlab # [ 1.828074] x86/mm: Checked W+X mappings: passed, no W+X pages found.470gitlab # [ 1.830058] Run /init as init process471gitlab # [ 1.846970] systemd[1]: Inserted module 'autofs4'472gitlab # [ 1.876052] fuse: init (API version 7.45)473gitlab # [ 1.900187] ACPI: \_SB_.LNKC: Enabled at IRQ 10474gitlab # [ 1.924290] ACPI: \_SB_.LNKA: Enabled at IRQ 10475gitlab # [ 1.950366] ACPI: \_SB_.LNKB: Enabled at IRQ 11476gitlab # [ 2.003418] systemd[1]: Successfully made /usr/ read-only.477gitlab # [ 2.343627] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)478gitlab # [ 2.364094] systemd[1]: Detected virtualization kvm.479gitlab # [ 2.367800] systemd[1]: Detected architecture x86-64.480gitlab # [ 2.371631] systemd[1]: Running in initrd.481gitlab # [ 2.376135] systemd[1]: Initializing machine ID from random generator.482gitlab # [ 2.381211] systemd[1]: Hostname set to <gitlab>.483gitlab # [ 2.459851] systemd[1]: Queued start job for default target Initrd Default Target.484gitlab # [ 2.624850] systemd[1]: Created slice Slice /system/modprobe.485gitlab # [ 2.629990] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.486gitlab # [ 2.636091] systemd[1]: Expecting device /dev/disk/by-label/nix-store...487gitlab # [ 2.641171] systemd[1]: Expecting device /dev/disk/by-label/nixos...488gitlab # [ 2.646161] systemd[1]: Reached target Path Units.489gitlab # [ 2.650173] systemd[1]: Reached target Slice Units.490gitlab # [ 2.654167] systemd[1]: Reached target Swaps.491gitlab # [ 2.657813] systemd[1]: Reached target Timer Units.492gitlab # [ 2.661480] systemd[1]: Listening on D-Bus System Message Bus Socket.493gitlab # [ 2.665617] systemd[1]: Listening on Journal Socket (/dev/log).494gitlab # [ 2.669560] systemd[1]: Listening on Journal Sockets.495gitlab # [ 2.673074] systemd[1]: Listening on udev Control Socket.496gitlab # [ 2.676645] systemd[1]: Listening on udev Kernel Socket.497gitlab # [ 2.678423] systemd[1]: Reached target Socket Units.498gitlab # [ 2.685066] systemd[1]: Starting Create List of Static Device Nodes...499gitlab # [ 2.691338] systemd[1]: Starting Load Kernel Module 9pnet_virtio...500gitlab # [ 2.708594] systemd[1]: Starting Load Kernel Module configfs...501gitlab # [ 2.713983] systemd[1]: Starting Journal Service...502gitlab # [ 2.723026] systemd[1]: Starting Load Kernel Modules...503gitlab # [ 2.732160] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki504gitlab # [ 2.737808] systemd-journald[153]: Collecting audit messages is disabled.505gitlab # [ 2.749651] systemd[1]: Starting Coldplug All udev Devices...506gitlab # [ 2.774301] netfs: FS-Cache loaded507gitlab # [ 2.777980] systemd[1]: Finished Create List of Static Device Nodes.508gitlab # [ 2.783723] systemd[1]: modprobe@configfs.service: Deactivated successfully.509gitlab # [ 2.790014] 9pnet: Installing 9P2000 support510gitlab # [ 2.792408] systemd[1]: Finished Load Kernel Module configfs.511gitlab # [ 2.797341] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config512gitlab # [ 2.797476] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.513gitlab # [ 2.800185] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...514gitlab # [ 2.805590] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev515gitlab # [ 2.810660] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.516gitlab # [ 2.819680] systemd[1]: Finished Load Kernel Module 9pnet_virtio.517gitlab # [ 2.567310] systemd-modules-load[155]: Using 4 probe threads518gitlab # [ 2.570929] systemd-modules-load[155]: Inserted module 'virtio_balloon'519gitlab # [ 2.572794] systemd-modules-load[155]: Insert[ 2.825752] systemd[1]: Started Journal Service.520gitlab # ed module 'virtio_gpu'521gitlab # [ 2.575566] systemd-modules-load[155]: Inserted module 'dm_mod'522gitlab # [ 2.577591] systemd[1]: Finished Load Kernel Modules.523gitlab # [ 2.579600] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.524gitlab # [ 2.586966] systemd[1]: Starting Apply Kernel Variables...525gitlab # [ 2.589647] systemd[1]: Starting Create Static Device Nodes in /dev...526gitlab # [ 2.602240] systemd[1]: Finished Apply Kernel Variables.527gitlab # [ 2.604724] systemd[1]: Finished Create Static Device Nodes in /dev.528gitlab # [ 2.606435] systemd[1]: Reached target Preparation for Local File Systems.529gitlab # [ 2.608100] systemd[1]: Reached target Local File Systems.530gitlab # [ 2.609459] systemd[1]: Starting Create System Files and Directories...531gitlab # [ 2.612248] systemd[1]: Starting Rule-based Manager for Device Events and Files...532gitlab # [ 2.638386] systemd[1]: Finished Create System Files and Directories.533gitlab # [ 2.642297] systemd-udevd[194]: Using default interface naming scheme 'v260'.534gitlab # [ 2.658956] systemd[1]: Started Rule-based Manager for Device Events and Files.535gitlab # [ 2.722737] systemd[1]: Finished Coldplug All udev Devices.536gitlab # [ 2.724638] systemd[1]: Reached target System Initialization.537gitlab # [ 2.726201] systemd[1]: Reached target Basic System.538gitlab # [ 3.115094] uhci_hcd 0000:00:01.2: UHCI Host Controller539gitlab # [ 3.116394] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1540gitlab # [ 3.118159] uhci_hcd 0000:00:01.2: detected 2 ports541gitlab # [ 3.121021] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140542gitlab # [ 3.122711] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18543gitlab # [ 3.124631] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1544gitlab # [ 3.126495] usb usb1: Product: UHCI Host Controller545gitlab # [ 3.127680] usb usb1: Manufacturer: Linux 6.18.34 uhci_hcd546gitlab # [ 3.129041] usb usb1: SerialNumber: 0000:00:01.2547gitlab # [ 3.133355] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12548gitlab # [ 3.136675] serio: i8042 KBD port at 0x60,0x64 irq 1549gitlab # [ 3.138020] SCSI subsystem initialized550gitlab # [ 3.138030] serio: i8042 AUX port at 0x60,0x64 irq 12551gitlab # [ 3.144325] virtio_blk virtio4: 4/0/0 default/read/poll queues552gitlab # [ 3.147065] hub 1-0:1.0: USB hub found553gitlab # [ 3.149936] hub 1-0:1.0: 2 ports detected554gitlab # [ 3.151825] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)555gitlab # [ 3.180242] virtio_blk virtio5: 4/0/0 default/read/poll queues556gitlab # [ 3.190053] scsi host0: ata_piix557gitlab # [ 3.190152] virtio_blk virtio5: [vdb] 11450752 512-byte logical blocks (5.86 GB/5.46 GiB)558gitlab # [ 3.193095] scsi host1: ata_piix559gitlab # [ 3.197076] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0560gitlab # [ 3.199067] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0561gitlab # [ 2.963091] (udev-worker)[205]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.562gitlab # [ 2.968503] (udev-worker)[205]: Network interface NamePolicy= disabled on kernel command line.563gitlab # [ 2.971254] (udev-worker)[203]: Network interface NamePolicy= disabled on kernel command line.564gitlab # [ 2.973687] systemd[1]: Starting Virtual Console Setup...565gitlab # [ 2.985107] systemd[1]: Found device /dev/disk/by-label/nixos.566gitlab # [ 2.990247] systemd[1]: Found device /dev/disk/by-label/nix-store.567gitlab # [ 2.991781] systemd[1]: Reached target Initrd Root Device.568gitlab # [ 2.994698] systemd-vconsole-setup[233]: Configuration of first virtual console was skipped, ignoring remaining ones.569gitlab # [ 2.997691] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...570gitlab # [ 2.999583] systemd[1]: Finished Virtual Console Setup.571gitlab # [ 3.019812] systemd-fsck[242]: nixos: clean, 12/65536 files, 13019/262144 blocks572gitlab # [ 3.025253] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.573gitlab # [ 3.360104] ata2: found unknown device (class 0)574gitlab # [ 3.364711] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100575gitlab # [ 3.372008] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5576gitlab # [ 3.377040] usb 1-1: new full-speed USB device number 2 using uhci_hcd577gitlab # [ 3.409509] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0578gitlab # [ 3.452411] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray579gitlab # [ 3.484315] cdrom: Uniform CD-ROM driver Revision: 3.20580gitlab # [ 3.547589] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00581gitlab # [ 3.552286] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10582gitlab # [ 3.556872] usb 1-1: Product: QEMU USB Tablet583gitlab # [ 3.559548] usb 1-1: Manufacturer: QEMU584gitlab # [ 3.562005] usb 1-1: SerialNumber: 28754-0000:00:01.2-1585gitlab # [ 3.603250] hid: raw HID events driver (C) Jiri Kosina586gitlab # [ 3.617257] usbcore: registered new interface driver usbhid587gitlab # [ 3.618638] usbhid: USB HID core driver588gitlab # [ 3.625765] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2589gitlab # [ 3.628972] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0590gitlab # [ 3.528457] systemd[1]: Mounting /sysroot...591gitlab # [ 3.953991] EXT4-fs (vda): mounted filesystem 6ffa7db4-8ead-4906-b189-868e6199a674 r/w with ordered data mode. Quota mode: none.592gitlab # [ 3.705493] systemd[1]: Mounted /sysroot.593gitlab # [ 3.707364] systemd[1]: Reached target Initrd Root File System.594gitlab # [ 3.710764] systemd[1]: Mounting /sysroot/nix/.ro-store...595gitlab # [ 3.713722] systemd[1]: Mounting /sysroot/nix/.rw-store...596gitlab # [ 3.716844] systemd[1]: Mounting /sysroot/run...597gitlab # [ 3.727133] systemd[1]: Mounting /sysroot/tmp/shared...598gitlab # [ 3.732875] systemd[1]: Mounting /sysroot/tmp/xchg...599gitlab # [ 3.993233] erofs (device vdb): mounted with root inode @ nid 128.600gitlab # [ 3.740882] systemd[1]: Starting Mountpoints Configured in the Real Root...601gitlab # [ 3.996474] 9p: Installing v9fs 9p2000 file system support602gitlab # [ 3.751123] systemd[1]: Mounted /sysroot/nix/.ro-store.603gitlab # [ 3.752611] systemd[1]: Mounted /sysroot/nix/.rw-store.604gitlab # [ 3.754110] systemd[1]: Mounted /sysroot/run.605gitlab # [ 3.755411] systemd[1]: Mounted /sysroot/tmp/shared.606gitlab # [ 3.756916] systemd[1]: Mounted /sysroot/tmp/xchg.607gitlab # [ 3.758526] systemd-sysroot-fstab-check[272]: /sysroot should be mounted in the initrd, will request daemon-reload.608gitlab # [ 3.762906] systemd[1]: Starting rw-sysroot-nix-store.service...609gitlab # [ 3.764385] systemd[1]: Reload requested from client PID 272 ('systemd-sysroot') (unit initrd-parse-etc.service)...610gitlab # [ 3.766899] systemd[1]: Reloading...611gitlab # [ 3.992811] systemd[1]: Reloading finished in 228 ms.612gitlab # [ 4.044257] systemd-sysroot-fstab-check[272]: Requesting initrd-fs.target/start/replace...613gitlab # [ 4.204538] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.614gitlab # [ 4.211571] systemd[1]: Finished rw-sysroot-nix-store.service.615gitlab # [ 4.223951] systemd-sysroot-fstab-check[272]: Requesting swap.target/start/replace...616gitlab # [ 4.231803] systemd[1]: Starting rw-sysroot-nix-store.service...617gitlab # [ 4.235465] systemd[1]: initrd-parse-etc.service: Deactivated successfully.618gitlab # [ 4.239549] systemd[1]: Finished Mountpoints Configured in the Real Root.619gitlab # [ 4.243689] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.620gitlab # [ 4.264333] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.621gitlab # [ 4.271478] systemd[1]: Finished rw-sysroot-nix-store.service.622gitlab # [ 4.530347] systemd[1]: Mounting /sysroot/nix/store...623gitlab # [ 4.582927] systemd[1]: Mounted /sysroot/nix/store.624gitlab # [ 4.586724] systemd[1]: Reached target Initrd File Systems.625gitlab # [ 4.592667] systemd[1]: Starting Find NixOS closure...626gitlab # [ 4.598206] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...627gitlab # [ 4.642743] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.628gitlab # [ 4.647450] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.629gitlab # [ 4.667518] systemd[1]: Finished Find NixOS closure.630gitlab # [ 4.670630] systemd[1]: Reached target Initrd Default Target.631gitlab # [ 4.678759] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...632gitlab # [ 4.723171] systemd[1]: Stopped target Initrd Default Target.633gitlab # [ 4.726663] systemd[1]: Stopped target Basic System.634gitlab # [ 4.729798] systemd[1]: Stopped target Initrd Root Device.635gitlab # [ 4.733142] systemd[1]: Stopped target Path Units.636gitlab # [ 4.736130] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.637gitlab # [ 4.740655] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.638gitlab # [ 4.745130] systemd[1]: Stopped target Slice Units.639gitlab # [ 4.748136] systemd[1]: Stopped target Socket Units.640gitlab # [ 4.751105] systemd[1]: Stopped target System Initialization.641gitlab # [ 4.754431] systemd[1]: Stopped target Swaps.642gitlab # [ 4.757212] systemd[1]: Stopped target Timer Units.643gitlab # [ 4.760123] systemd[1]: dbus.socket: Deactivated successfully.644gitlab # [ 4.763479] systemd[1]: Closed D-Bus System Message Bus Socket.645gitlab # [ 4.766625] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.646gitlab # [ 4.769983] systemd[1]: Stopped Find NixOS closure.647gitlab # [ 4.773308] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio648gitlab # [ 4.778743] systemd[1]: Starting rw-sysroot-nix-store.service...649gitlab # [ 4.782319] systemd[1]: systemd-sysctl.service: Deactivated successfully.650gitlab # [ 4.785591] systemd[1]: Stopped Apply Kernel Variables.651gitlab # [ 4.788105] systemd[1]: systemd-modules-load.service: Deactivated successfully.652gitlab # [ 4.790399] systemd[1]: Stopped Load Kernel Modules.653gitlab # [ 4.791928] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.654gitlab # [ 4.794831] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.655gitlab # [ 4.796866] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.656gitlab # [ 4.799209] systemd[1]: Stopped Create System Files and Directories.657gitlab # [ 4.801100] systemd[1]: Stopped target Local File Systems.658gitlab # [ 4.802514] systemd[1]: Stopped target Preparation for Local File Systems.659gitlab # [ 4.804168] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.660gitlab # [ 4.805880] systemd[1]: Stopped Coldplug All udev Devices.661gitlab # [ 4.807453] systemd[1]: Stopping Rule-based Manager for Device Events and Files...662gitlab # [ 4.809899] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.663gitlab # [ 4.811637] systemd[1]: Stopped Virtual Console Setup.664gitlab # [ 4.812901] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.665gitlab # [ 4.814574] systemd[1]: Finished rw-sysroot-nix-store.service.666gitlab # [ 4.822120] systemd[1]: initrd-cleanup.service: Deactivated successfully.667gitlab # [ 4.824141] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.668gitlab # [ 4.829575] systemd[1]: systemd-udevd.service: Deactivated successfully.669gitlab # [ 4.833974] systemd[1]: Stopped Rule-based Manager for Device Events and Files.670gitlab # [ 4.835807] systemd[1]: systemd-udevd.service: Consumed 1.126s CPU time over 2.217s wall clock time, 26.7M memory peak.671gitlab # [ 4.842652] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.672gitlab # [ 4.844393] systemd[1]: Closed udev Control Socket.673gitlab # [ 4.848113] systemd[1]: Starting Cleanup udev Database...674gitlab # [ 4.849464] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.675gitlab # [ 4.851279] systemd[1]: Stopped Create Static Device Nodes in /dev.676gitlab # [ 4.852824] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.677gitlab # [ 4.854689] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.678gitlab # [ 4.857763] systemd[1]: kmod-static-nodes.service: Deactivated successfully.679gitlab # [ 4.859454] systemd[1]: Stopped Create List of Static Device Nodes.680gitlab # [ 4.875814] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.681gitlab # [ 4.879315] systemd[1]: Finished Cleanup udev Database.682gitlab # [ 4.883740] systemd[1]: Reached target Switch Root.683gitlab # [ 4.886742] systemd[1]: Starting NixOS Activation...684gitlab # [ 5.014820] initrd-nixos-activation-start[570]: booting system configuration /nix/store/c8naaw9zklfrairqn6azrkxflp57y6li-nixos-system-gitlab-test685gitlab # [ 5.060421] initrd-nixos-activation-start[570]: running activation script...686gitlab # [ 5.294172] initrd-nixos-activation-start[593]: setting up /etc...687gitlab # [ 5.394382] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.688gitlab # [ 5.399325] systemd[1]: Finished NixOS Activation.689gitlab # [ 5.414493] systemd[1]: Starting Switch Root...690gitlab # [ 5.448231] systemd[1]: Switching root.691gitlab # [ 6.102196] systemd-journald[153]: Received SIGTERM from PID 1 (systemd).692gitlab # [ 6.228289] NET: Registered PF_VSOCK protocol family693gitlab # [ 6.602236] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)694gitlab # [ 6.618231] systemd[1]: Detected virtualization kvm.695gitlab # [ 6.621390] systemd[1]: Detected architecture x86-64.696gitlab # [ 6.624666] systemd[1]: Detected first boot.697gitlab # [ 6.628742] systemd[1]: Initializing machine ID from random generator.698gitlab # [ 6.769943] systemd[1]: bpf-restrict-fs: LSM BPF program attached699gitlab # [ 6.841619] systemd[1]: Applying preset policy.700gitlab # [ 7.021305] systemd[1]: Populated /etc with preset unit settings.701gitlab # [ 7.136823] systemd[1]: initrd-switch-root.service: Deactivated successfully.702gitlab # [ 7.139471] systemd[1]: Stopped initrd-switch-root.service.703gitlab # [ 7.142962] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.704gitlab # [ 7.146119] systemd[1]: Created slice Slice /system/getty.705gitlab # [ 7.148272] systemd[1]: Created slice GitLab DevOps Platform Slice.706gitlab # [ 7.150540] systemd[1]: Created slice User and Session Slice.707gitlab # [ 7.152235] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.708gitlab # [ 7.154224] systemd[1]: Started Forward Password Requests to Wall Directory Watch.709gitlab # [ 7.156037] systemd[1]: Expecting device /dev/hvc0...710gitlab # [ 7.157267] systemd[1]: Expecting device /dev/ttyS0...711gitlab # [ 7.158610] systemd[1]: Reached target Local Encrypted Volumes.712gitlab # [ 7.160150] systemd[1]: Stopped target initrd-fs.target.713gitlab # [ 7.161465] systemd[1]: Stopped target initrd-root-fs.target.714gitlab # [ 7.162916] systemd[1]: Stopped target initrd-switch-root.target.715gitlab # [ 7.164469] systemd[1]: Reached target Virtual Machines and Containers.716gitlab # [ 7.166066] systemd[1]: Reached target Path Units.717gitlab # [ 7.167314] systemd[1]: Reached target Remote File Systems.718gitlab # [ 7.168734] systemd[1]: Reached target Slice Units.719gitlab # [ 7.170056] systemd[1]: Reached target Swaps.720gitlab # [ 7.172394] systemd[1]: Listening on Process Core Dump Socket.721gitlab # [ 7.174463] systemd[1]: Listening on Credential Encryption/Decryption.722gitlab # [ 7.177844] systemd[1]: Starting Journal Log Access Socket...723gitlab # [ 7.180344] systemd[1]: Listening on Journal Audit Socket.724gitlab # [ 7.182147] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.725gitlab # [ 7.184088] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki726gitlab # [ 7.186499] systemd[1]: Listening on udev Control Socket.727gitlab # [ 7.190316] systemd[1]: Mounting Huge Pages File System...728gitlab # [ 7.193325] systemd[1]: Mounting POSIX Message Queue File System...729gitlab # [ 7.196523] systemd[1]: Mounting Kernel Debug File System...730gitlab # [ 7.201010] systemd[1]: Mounting Kernel Trace File System...731gitlab # [ 7.213922] systemd[1]: Starting Create List of Static Device Nodes...732gitlab # [ 7.216995] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio733gitlab # [ 7.222657] systemd[1]: Starting Load Kernel Module configfs...734gitlab # [ 7.226563] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm735gitlab # [ 7.232787] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore736gitlab # [ 7.233119] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse737gitlab # [ 7.257236] systemd[1]: Mounting FUSE Control File System...738gitlab # [ 7.260874] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67739gitlab # [ 7.274265] systemd[1]: Starting Journal Service...740gitlab # [ 7.279548] systemd[1]: Starting Load Kernel Modules...741gitlab # [ 7.299254] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...742gitlab # [ 7.303022] systemd[1]: Starting Remount Root and Kernel File Systems...743gitlab # [ 7.316728] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki744gitlab # [ 7.318266] systemd[1]: Starting Coldplug All udev Devices...745gitlab # [ 7.326181] systemd[1]: Listening on Journal Log Access Socket.746gitlab # [ 7.330527] systemd[1]: Mounted Huge Pages File System.747gitlab # [ 7.330962] loop: module loaded748gitlab # [ 7.331716] systemd[1]: Mounted POSIX Message Queue File System.749gitlab # [ 7.334020] systemd-journald[787]: Collecting audit messages is enabled.750gitlab # [ 7.334493] systemd[1]: Mounted Kernel Debug File System.751gitlab # [ 7.338453] systemd[1]: Mounted Kernel Trace File System.752gitlab # [ 7.340724] systemd[1]: Finished Create List of Static Device Nodes.753gitlab # [ 7.342714] systemd[1]: modprobe@configfs.service: Deactivated successfully.754gitlab # [ 7.348966] EXT4-fs (vda): re-mounted 6ffa7db4-8ead-4906-b189-868e6199a674.755gitlab # [ 7.350321] systemd[1]: Finished Load Kernel Module configfs.756gitlab # [ 7.100457] systemd[1]: Queued start job for default target Multi-User System.757gitlab # [ 7.355145] systemd[1]: Started Journal Service.758gitlab # [ 7.102616] systemd[1]: Unnecessary job was removed for /dev/vdb.759gitlab # [ 7.105589] systemd[1]: systemd-journald.service: Deactivated successfully.760gitlab # [ 7.107956] systemd-modules-load[788]: Using 3 probe threads761gitlab # [ 7.109721] systemd-modules-load[788]: Inserted module 'tls'762gitlab # [ 7.111520] systemd-modules-load[788]: Inserted module 'loop'763gitlab # [ 7.113264] systemd[1]: Mounted FUSE Control File System.764gitlab # [ 7.114914] systemd[1]: Finished Load Kernel Modules.765gitlab # [ 7.116737] systemd-oomd[790]: No swap; memory pressure usage will be degraded766gitlab # [ 7.119327] systemd[1]: Finished Remount Root and Kernel File Systems.767gitlab # [ 7.121227] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.768gitlab # [ 7.132347] systemd[1]: Mounting Kernel Configuration File System...769gitlab # [ 7.136116] systemd[1]: Starting Firewall...770gitlab # [ 7.140328] systemd[1]: Starting Flush Journal to Persistent Storage...771gitlab # [ 7.142066] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore772gitlab # [ 7.146446] systemd[1]: Starting Load/Save OS Random Seed...773gitlab # [ 7.151212] systemd[1]: Starting Apply Kernel Variables...774gitlab # [ 7.158142] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...775gitlab # [ 7.161371] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki776gitlab # [ 7.163868] systemd[1]: Mounted Kernel Configuration File System.777gitlab # [ 7.419006] systemd-journald[787]: Received client request to flush runtime journal.778gitlab # [ 7.240138] systemd[1]: Finished Load/Save OS Random Seed.779gitlab # [ 7.243714] systemd[1]: Reached target First Boot Complete.780gitlab # [ 7.245955] systemd[1]: Finished Apply Kernel Variables.781gitlab # [ 7.248400] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.782gitlab # [ 7.250183] systemd[1]: Starting Create Static Device Nodes in /dev...783gitlab # [ 7.251753] systemd[1]: Finished Create Static Device Nodes in /dev.784gitlab # [ 7.253290] systemd[1]: Reached target Preparation for Local File Systems.785gitlab # [ 7.254875] systemd[1]: Starting Rule-based Manager for Device Events and Files...786gitlab # [ 7.256654] systemd[1]: Finished Flush Journal to Persistent Storage.787gitlab # [ 7.281760] systemd-udevd[838]: Using default interface naming scheme 'v260'.788gitlab # [ 7.300795] systemd[1]: Finished Coldplug All udev Devices.789gitlab # [ 7.319336] systemd[1]: Started Rule-based Manager for Device Events and Files.790gitlab # [ 7.441572] systemd[1]: Finished Firewall.791gitlab # [ 7.448847] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse792gitlab # [ 7.485772] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.793gitlab # [ 7.495631] (udev-worker)[927]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.794gitlab # [ 7.499469] (udev-worker)[927]: Network interface NamePolicy= disabled on kernel command line.795gitlab # [ 7.501620] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.796gitlab # [ 7.510624] (udev-worker)[930]: Network interface NamePolicy= disabled on kernel command line.797gitlab # [ 7.521595] systemd[1]: Condition check resulted in Virtio network device being skipped.798gitlab # [ 7.523641] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore799gitlab # [ 7.526270] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67800gitlab # [ 7.529902] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore801gitlab # [ 7.532557] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki802gitlab # [ 7.534726] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki803gitlab # [ 7.802074] mousedev: PS/2 mouse device common for all mice804gitlab # [ 7.819700] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3805gitlab # [ 7.856003] ACPI: button: Power Button [PWRF]806gitlab # [ 7.862068] rtc_cmos 00:05: RTC can wake from S4807gitlab # [ 7.866862] parport_pc 00:03: reported by Plug and Play ACPI808gitlab # [ 7.868418] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]809gitlab # [ 7.870324] Floppy drive(s): fd0 is 2.88M AMI BIOS810gitlab # [ 7.880900] rtc_cmos 00:05: registered as rtc0811gitlab # [ 7.882778] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5812gitlab # [ 7.882826] rtc_cmos 00:05: setting system clock to 2026-07-06T10:54:01 UTC (1783335241)813gitlab # [ 7.882845] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console814gitlab # [ 7.884776] systemd-journald[787]: Time jumped backwards, rotating.815gitlab # [ 7.885834] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs816gitlab # [ 7.889545] FDC 0 is a S82078B817gitlab # [ 7.898141] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0818gitlab # [ 7.898222] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD819gitlab # [ 7.905787] Console: switching to colour dummy device 80x25820gitlab # [ 7.911579] [drm] Found bochs VGA, ID 0xb0c5.821gitlab # [ 7.912921] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.822gitlab # [ 7.917291] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic823gitlab # [ 7.919554] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0824gitlab # [ 7.921287] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6825gitlab # [ 7.931193] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4826gitlab # [ 7.932718] fbcon: bochs-drmdrmfb (fb0) is primary device827gitlab # [ 7.938610] Console: switching to colour frame buffer device 160x50828gitlab # [ 7.941778] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device829gitlab # [ 7.762050] systemd[1]: Starting Virtual Console Setup...830gitlab # [ 8.057081] erofs (device vdb): failed to read inode meta block (nid: 108761696): -4831gitlab # [ 7.809784] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.832gitlab # [ 7.812079] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 8.076808] kvm_amd: TSC scaling supported834gitlab # [ 8.078085] kvm_amd: Nested Virtualization enabled835gitlab # [ 8.079286] kvm_amd: Nested Paging enabled836gitlab # [ 8.080239] kvm_amd: LBR virtualization supported837gitlab # [ 8.081335] kvm_amd: Virtual VMLOAD VMSAVE supported838gitlab # [ 8.082496] kvm_amd: Virtual GIF supported839gitlab # [ 8.083503] kvm_amd: Virtual NMI enabled840gitlab # [ 7.843560] systemd[1]: Starting Virtual Console Setup...841gitlab # [ 8.107330] ppdev: user-space parallel port driver842gitlab # [ 8.131518] EDAC MC: Ver: 3.0.0843gitlab # [ 7.886465] systemd[1]: Mounting /run/wrappers...844gitlab # [ 7.903947] systemd-vconsole-setup[961]: Configuration of first virtual console was skipped, ignoring remaining ones.845gitlab # [ 7.907103] systemd[1]: Finished Virtual Console Setup.846gitlab # [ 7.912201] systemd[1]: Mounted /run/wrappers.847gitlab # [ 7.913444] systemd[1]: Reached target Local File Systems.848gitlab # [ 7.914842] systemd[1]: Listening on Boot Loader Control Service Socket.849gitlab # [ 7.916641] systemd[1]: Starting register-nix-paths.service...850gitlab # [ 7.918250] systemd[1]: Starting Create SUID/SGID Wrappers...851gitlab # [ 7.919668] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.852gitlab # [ 7.921793] systemd[1]: Starting Save Transient machine-id to Disk...853gitlab # [ 7.924299] systemd[1]: Starting Create System Files and Directories...854gitlab # [ 7.958063] systemd[1]: Finished Create System Files and Directories.855gitlab # [ 7.962540] systemd[1]: Starting Rebuild Journal Catalog...856gitlab # [ 7.964281] systemd[1]: Starting Record System Boot/Shutdown in UTMP...857gitlab # [ 7.966185] systemd[1]: Finished Save Transient machine-id to Disk.858gitlab # [ 7.981551] systemd[1]: Finished Record System Boot/Shutdown in UTMP.859gitlab # [ 7.995870] systemd[1]: Finished Rebuild Journal Catalog.860gitlab # [ 7.998105] systemd[1]: Starting Update is Completed...861gitlab # [ 8.013506] systemd[1]: Finished Update is Completed.862gitlab # [ 8.068100] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.863gitlab # [ 8.070192] systemd[1]: Finished Create SUID/SGID Wrappers.864gitlab # [ 8.071724] systemd[1]: suid-sgid-wrappers.service: Consumed 120ms CPU time over 150ms wall clock time, 4.7M memory peak, 1.1M read from disk.865gitlab # [ 8.317051] systemd[1]: Finished register-nix-paths.service.866gitlab # [ 8.320322] systemd[1]: Reached target System Initialization.867gitlab # [ 8.323468] systemd[1]: Started Discard unused filesystem blocks once a week.868gitlab # [ 8.327295] systemd[1]: Started logrotate.timer.869gitlab # [ 8.329839] systemd[1]: Started Daily Cleanup of Temporary Directories.870gitlab # [ 8.333384] systemd[1]: Reached target Timer Units.871gitlab # [ 8.335992] systemd[1]: Listening on D-Bus System Message Bus Socket.872gitlab # [ 8.339662] systemd[1]: Listening on Nix Daemon Socket.873gitlab # [ 8.342573] systemd[1]: Starting nixbot CI service socket...874gitlab # [ 8.345664] systemd[1]: Listening on Hostname Service Socket.875gitlab # [ 8.348745] systemd[1]: Listening on nixbot CI service socket.876gitlab # [ 8.351823] systemd[1]: Reached target Socket Units.877gitlab # [ 8.354578] systemd[1]: Starting D-Bus System Message Bus...878gitlab # [ 8.411172] dbus-broker-launch[1051]: Looking up NSS user entry for 'systemd-timesync'...879gitlab # [ 8.416374] dbus-broker-launch[1051]: NSS returned no entry for 'systemd-timesync'880gitlab # [ 8.420902] dbus-broker-launch[1051]: Invalid user-name in /nix/store/89zj9nmrajvcy9c3c08wv0ir9ww7lgmq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"881gitlab # [ 8.429682] systemd[1]: Started D-Bus System Message Bus.882gitlab # [ 8.438921] dbus-broker-launch[1051]: Ready883gitlab # [ 8.441629] systemd[1]: Reached target Basic System.884gitlab # [ 8.444460] systemd[1]: Started backdoor.service.885gitlab # [ 8.447685] systemd[1]: Starting gitlab-config.service...886gitlab # [ 8.451823] systemd[1]: Starting Import lastlog data into lastlog2 database...887gitlab # [ 8.455648] systemd[1]: Starting Logrotate configuration check...888gitlab # [ 8.464272] systemd[1]: Starting Name Service Cache Daemon (nsncd)...889gitlab # [ 8.472108] systemd[1]: Starting Post-Boot Actions...890gitlab # [ 8.474389] systemd[1]: Started Reset console on configuration changes.891gitlab # [ 8.484767] systemd[1]: Starting resolvconf update...892gitlab # [ 8.488543] logrotate[1056]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.893gitlab # connecting to host...894gitlab # [ 8.492231] logrotate[1056]: reading config file /nix/store/sn4bd2nqi3yg4r51djm9i2rmfgbwvmhb-logrotate.conf895gitlab # [ 8.493203] logrotate[1056]: note: 'monthly' overrides previously specified 'weekly'896gitlab # [ 8.493811] logrotate[1056]: Reading state from file: /var/lib/logrotate.status897gitlab # [ 8.494945] logrotate[1056]: state file /var/lib/logrotate.status does not exist898gitlab # [ 8.496649] logrotate[1056]: Allocating hash table for state file, size 64 entries899gitlab # [ 8.497911] logrotate[1056]: Handling 4 logs900gitlab: Guest shell says: b'Spawning backdoor root shell...\n'901gitlab: connected to guest root shell902gitlab # [ 8.498963] logrotate[1056]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed903gitlab: (connecting took 9.33 seconds)904gitlab # [ 8.500158] logrotate[1056]: considering log /var/log/btmp905gitlab: (finished: waiting for the VM to finish booting, in 9.33 seconds)906gitlab # [ 8.501096] logrotate[1056]: Creating new state907gitlab # [ 8.501909] logrotate[1056]: Now: 2026-07-06 10:54908gitlab # [ 8.503082] logrotate[1056]: Last rotated at 2026-07-06 10:00909gitlab # [ 8.504061] logrotate[1056]: log does not need rotating (log has already been rotated)910gitlab # [ 8.504775] logrotate[1056]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed911gitlab # [ 8.505876] logrotate[1056]: considering log /var/log/wtmp912gitlab # [ 8.506897] logrotate[1056]: Creating new state913gitlab # [ 8.507931] logrotate[1056]: Now: 2026-07-06 10:54914gitlab # [ 8.508993] logrotate[1056]: Last rotated at 2026-07-06 10:00915gitlab # [ 8.509787] logrotate[1056]: log does not need rotating (log has already been rotated)916gitlab # [ 8.510617] logrotate[1056]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed917gitlab # [ 8.511665] logrotate[1056]: switching euid from 0 to 165 and egid from 0 to 165 (pid 1056)918gitlab # [ 8.512714] logrotate[1056]: considering log /var/gitlab/state/log/*.log919gitlab # [ 8.513764] logrotate[1056]: log /var/gitlab/state/log/*.log does not exist -- skipping920gitlab # [ 8.514944] logrotate[1056]: Creating new state921gitlab # [ 8.516055] logrotate[1056]: switching euid from 165 to 0 and egid from 165 to 0 (pid 1056)922gitlab # [ 8.516908] logrotate[1056]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed923gitlab # [ 8.518592] logrotate[1056]: switching euid from 0 to 60 and egid from 0 to 60 (pid 1056)924gitlab # [ 8.519722] logrotate[1056]: considering log /var/log/nginx/*.log925gitlab # [ 8.521213] logrotate[1056]: log /var/log/nginx/*.log does not exist -- skipping926gitlab # [ 8.522081] logrotate[1056]: Creating new state927gitlab # [ 8.522869] logrotate[1056]: switching euid from 60 to 0 and egid from 60 to 0 (pid 1056)928gitlab # [ 8.561190] systemd[1]: Started Name Service Cache Daemon (nsncd).929gitlab # [ 8.562193] nsncd[1057]: Jul 06 10:54:02.430 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"930gitlab # [ 8.563066] systemd[1]: Finished Logrotate configuration check.931gitlab # [ 8.564105] systemd[1]: Finished Post-Boot Actions.932gitlab # [ 8.569503] systemd[1]: Finished Import lastlog data into lastlog2 database.933gitlab # [ 8.581823] systemd[1]: Reached target Host and Network Name Lookups.934gitlab # [ 8.582934] systemd[1]: Reached target User and Group Name Lookups.935gitlab # [ 8.587130] systemd[1]: Starting User Login Management...936gitlab # [ 8.605526] systemd[1]: Stopped target Host and Network Name Lookups.937gitlab # [ 8.606452] systemd[1]: Stopping Host and Network Name Lookups...938gitlab # [ 8.607785] systemd[1]: Stopped target User and Group Name Lookups.939gitlab # [ 8.609664] systemd[1]: Stopping User and Group Name Lookups...940gitlab # [ 8.610468] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...941gitlab # [ 8.614279] systemd[1]: nscd.service: Deactivated successfully.942gitlab # [ 8.618125] systemd[1]: Stopped Name Service Cache Daemon (nsncd).943gitlab # [ 8.621088] systemd[1]: nscd.service: Consumed 72ms CPU time over 150ms wall clock time, 7.7M memory peak, 5.6M read from disk.944gitlab # [ 8.625530] systemd[1]: Starting Name Service Cache Daemon (nsncd)...945gitlab # [ 8.639709] systemd-logind[1116]: New seat seat0.946gitlab # [ 8.642614] systemd-logind[1116]: Watching system buttons on /dev/input/event2 (Power Button)947gitlab # [ 8.643648] systemd-logind[1116]: Watching system buttons on /dev/input/event4 (QEMU Virtio Keyboard)948gitlab # [ 8.644676] systemd-logind[1116]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)949gitlab # [ 8.645586] systemd[1]: Started User Login Management.950gitlab # [ 8.646737] systemd[1]: Finished resolvconf update.951gitlab # [ 8.652098] systemd[1]: Reached target Preparation for Network.952gitlab # [ 8.656133] systemd[1]: Starting DHCP Client...953gitlab # [ 8.658621] nsncd[1145]: Jul 06 10:54:02.528 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"954gitlab # [ 8.660483] systemd[1]: Starting linger-users.service...955gitlab # [ 8.664103] systemd[1]: Starting Address configuration of eth1...956gitlab # [ 8.666450] systemd[1]: Starting Extra networking commands....957gitlab # [ 8.669741] systemd[1]: Started Name Service Cache Daemon (nsncd).958gitlab # [ 8.672663] systemd[1]: Reached target Host and Network Name Lookups.959gitlab # [ 8.674315] systemd[1]: Reached target User and Group Name Lookups.960gitlab # [ 8.690130] systemd[1]: linger-users.service: Deactivated successfully.961gitlab # [ 8.692913] systemd[1]: Finished linger-users.service.962gitlab # [ 8.701410] network-addresses-eth1-start[1167]: adding address 192.168.1.1/24... done963gitlab # [ 8.706784] network-addresses-eth1-start[1167]: adding address 2001:db8:1::1/64... done964gitlab # [ 8.715939] systemd[1]: Finished Address configuration of eth1.965gitlab # [ 8.745077] systemd[1]: Finished Extra networking commands..966gitlab # [ 8.746506] systemd[1]: Reached target Network.967gitlab # [ 8.749350] systemd[1]: Starting gitlab-workhorse.service...968gitlab # [ 8.751713] dhcpcd[1182]: dhcpcd-10.3.2 starting969gitlab # [ 8.752941] systemd[1]: Starting Nginx Web Server...970gitlab # [ 8.756194] dhcpcd[1228]: dev: loaded udev971gitlab # [ 8.759848] systemd[1]: Starting PostgreSQL Server...972gitlab # [ 9.016169] 8021q: 802.1Q VLAN Support v1.8973gitlab # [ 9.017201] 8021q: adding VLAN 0 to HW filter on device eth1974gitlab # [ 8.765732] systemd[1]: Starting Redis Server - redis-gitlab...975gitlab # [ 8.769426] systemd[1]: Starting Permit User Sessions...976gitlab # [ 8.785197] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.977gitlab # [ 8.802362] systemd[1]: Finished Permit User Sessions.978gitlab # [ 8.810595] systemd[1]: Started Getty on tty1.979gitlab # [ 8.814101] systemd[1]: Reached target Login Prompts.980gitlab # [ 9.111407] cfg80211: Loading compiled-in X.509 certificates for regulatory database981gitlab # [ 9.118168] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'982gitlab # [ 9.119731] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'983gitlab # [ 9.122154] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2984gitlab # [ 9.123939] cfg80211: failed to load regulatory.db985gitlab # [ 8.889259] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.986gitlab # [ 8.901596] nginx-pre-start[1252]: nginx: the configuration file /nix/store/nlpb2pnbsk0921apk[ 9.156014] 8021q: adding VLAN 0 to HW filter on device eth0987gitlab # v5yml2qxbm30d7w-nginx.conf syntax is ok988gitlab # [ 8.907175] nginx-pre-start[1252]: nginx: configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf test is successful989gitlab # [ 8.910460] dhcpcd[1228]: eth0: waiting for carrier990gitlab # [ 8.912264] dhcpcd[1228]: eth0: carrier acquired991gitlab # [ 8.913907] dhcpcd[1228]: DUID 00:01:00:01:31:de:45:ca:52:54:00:12:34:56992gitlab # [ 8.915871] systemd[1]: Started Nginx Web Server.993gitlab # [ 8.917352] dhcpcd[1228]: eth0: IAID 00:12:34:56994gitlab # [ 8.918823] dhcpcd[1228]: eth0: adding address fe80::5054:ff:fe12:3456995gitlab # [ 8.920656] systemd[1]: Started Redis Server - redis-gitlab.996gitlab # [ 8.922567] redis-server[1250]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.997gitlab # [ 8.926450] redis-server[1250]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo998gitlab # [ 8.928662] redis-server[1250]: Redis version=8.8.0, bits=64, commit=00000000, modified=0, pid=1250, just started999gitlab # [ 8.932084] redis-server[1250]: Configuration loaded1000gitlab # [ 8.933951] redis[1250]: monotonic clock: POSIX clock_gettime1001gitlab # [ 8.935936] redis[1250]: Running mode=standalone, port=0.1002gitlab # [ 8.937968] redis[1250]: Server initialized1003gitlab # [ 8.939586] redis[1250]: Ready to accept connections unix1004gitlab # [ 8.941536] redis[1250]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1005gitlab # [ 8.945524] postgresql-pre-start[1260]: The files belonging to this database system will be owned by user "postgres".1006gitlab # [ 8.948381] postgresql-pre-start[1260]: This user must also own the server process.1007gitlab # [ 8.950745] postgresql-pre-start[1260]: The database cluster will be initialized with locale "en_US.UTF-8".1008gitlab # [ 8.951331] postgresql-pre-start[1260]: The default database encoding has accordingly been set to "UTF8".1009gitlab # [ 8.952904] postgresql-pre-start[1260]: The default text search configuration will be set to "english".1010gitlab # [ 8.954356] postgresql-pre-start[1260]: Data page checksums are disabled.1011gitlab # [ 8.955113] postgresql-pre-start[1260]: fixing permissions on existing directory /var/lib/postgresql/17 ... ok1012gitlab # [ 8.956051] postgresql-pre-start[1260]: creating subdirectories ... ok1013gitlab # [ 8.956968] postgresql-pre-start[1260]: selecting dynamic shared memory implementation ... posix1014gitlab # [ 8.992109] postgresql-pre-start[1260]: selecting default "max_connections" ... 1001015gitlab # [ 9.023792] postgresql-pre-start[1260]: selecting default "shared_buffers" ... 128MB1016gitlab # [ 9.224122] systemd[1]: Started gitlab-workhorse.service.1017gitlab # [ 9.387249] postgresql-pre-start[1260]: selecting default time zone ... UTC1018gitlab # [ 9.388840] postgresql-pre-start[1260]: creating configuration files ... ok1019gitlab # [ 9.520419] gitlab-workhorse[1287]: time="2026-07-06T10:54:03Z" level=info msg=Starting build_time=19700101.000000 version=18.11.41020gitlab # [ 9.523390] gitlab-workhorse[1287]: time="2026-07-06T10:54:03Z" level=info msg="Using redis/go-redis"1021gitlab # [ 9.525931] gitlab-workhorse[1287]: time="2026-07-06T10:54:03Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1022gitlab # [ 9.571760] postgresql-pre-start[1260]: running bootstrap script ... ok1023gitlab # [ 10.042821] postgresql-pre-start[1260]: performing post-bootstrap initialization ... ok1024gitlab # [ 10.272572] dhcpcd[1228]: eth0: soliciting a DHCP lease1025gitlab # [ 10.536575] NET: Registered PF_PACKET protocol family1026gitlab # [ 10.292489] dhcpcd[1228]: eth0: offered 10.0.2.15 from 10.0.2.21027gitlab # [ 10.298549] dhcpcd[1228]: eth0: probing address 10.0.2.15/241028gitlab # [ 10.430703] postgresql-pre-start[1260]: syncing data to disk ... ok1029gitlab # [ 10.432174] postgresql-pre-start[1260]: initdb: warning: enabling "trust" authentication for local connections1030gitlab # [ 10.434935] postgresql-pre-start[1260]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1031gitlab # [ 10.439284] postgresql-pre-start[1260]: Success. You can now start the database server using:1032gitlab # [ 10.442235] postgresql-pre-start[1260]: pg_ctl -D /var/lib/postgresql/17 -l logfile start1033gitlab # [ 10.567271] postgres[1314]: [1314] LOG: starting PostgreSQL 17.10 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1034gitlab # [ 10.574735] postgres[1314]: [1314] LOG: listening on IPv6 address "::1", port 54321035gitlab # [ 10.579764] postgres[1314]: [1314] LOG: listening on IPv4 address "127.0.0.1", port 54321036gitlab # [ 10.584676] postgres[1314]: [1314] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1037gitlab # [ 10.591275] postgres[1320]: [1320] LOG: database system was shut down at 2026-07-06 10:54:03 GMT1038gitlab # [ 10.596948] postgres[1314]: [1314] LOG: database system is ready to accept connections1039gitlab # [ 10.603329] systemd[1]: Started PostgreSQL Server.1040gitlab # [ 10.606639] systemd[1]: Starting PostgreSQL Setup Scripts...1041gitlab # [ 10.757237] postgresql-setup-start[1340]: CREATE DATABASE1042gitlab # [ 10.787859] postgresql-setup-start[1345]: CREATE ROLE1043gitlab # [ 10.800184] postgresql-setup-start[1347]: ALTER DATABASE1044gitlab # [ 10.833168] postgresql-setup-start[1352]: CREATE ROLE1045gitlab # [ 10.837799] systemd[1]: Finished PostgreSQL Setup Scripts.1046gitlab # [ 10.840082] systemd[1]: Reached target PostgreSQL.1047gitlab # [ 10.844686] systemd[1]: Starting gitlab-postgresql.service...1048gitlab # [ 10.952266] gitlab-postgresql-start[1364]: CREATE DATABASE1049gitlab # [ 10.995422] gitlab-postgresql-start[1369]: CREATE EXTENSION1050gitlab # [ 11.012507] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1362]: mkdir -p /var/gitlab/state/home/.ssh: OK1051gitlab # [ 11.015490] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1362]: chmod 700 /var/gitlab/state/home/.ssh: OK1052gitlab # [ 11.055732] gitlab-postgresql-start[1371]: CREATE EXTENSION1053gitlab # [ 11.061295] systemd[1]: Finished gitlab-postgresql.service.1054gitlab # [ 11.076214] systemd[1]: Finished gitlab-config.service.1055gitlab # [ 11.079960] systemd[1]: Started gitaly.service.1056gitlab # [ 11.083508] systemd[1]: Starting gitlab-db-config.service...1057gitlab # [ 11.366874] dhcpcd[1228]: eth0: soliciting an IPv6 router1058gitlab # [ 11.368776] dhcpcd[1228]: eth0: Router Advertisement from fe80::21059gitlab # [ 11.370167] dhcpcd[1228]: eth0: adding address fec0::5054:ff:fe12:3456/641060gitlab # [ 11.372205] dhcpcd[1228]: eth0: adding route to fec0::/641061gitlab # [ 11.374408] dhcpcd[1228]: eth0: adding default route via fe80::21062gitlab # [ 11.715768] gitaly[1386]: time="2026-07-06T10:54:05.584Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/2wcq0nlg508fs5wq7jnpg1lw2pib950g-gitaly.toml' and fix the errors that are printed." pid=13861063gitlab # [ 11.716496] gitaly[1386]: time="2026-07-06T10:54:05.584Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=13861064gitlab # [ 11.717742] gitaly[1386]: time="2026-07-06T10:54:05.584Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=13861065gitlab # [ 11.718903] gitaly[1386]: time="2026-07-06T10:54:05.585Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=13861066gitlab # [ 11.720949] gitaly[1386]: time="2026-07-06T10:54:05.585Z" level=info msg="Starting Gitaly" pid=1386 version=18.11.41067gitlab # [ 11.916457] gitaly[1386]: time="2026-07-06T10:54:05.786Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=200 pid=13861068gitlab # [ 11.917984] gitaly[1386]: time="2026-07-06T10:54:05.787Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=13861069gitlab # [ 11.918949] gitaly[1386]: time="2026-07-06T10:54:05.787Z" level=info msg="finished initializing command factory" duration_ms=0 pid=13861070gitlab # [ 11.920428] gitaly[1386]: time="2026-07-06T10:54:05.787Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-1386/git-exec-726242362.d/git pid=13861071gitlab # [ 11.924124] gitaly[1386]: time="2026-07-06T10:54:05.794Z" level=info msg="finished detecting git version" duration_ms=6 pid=13861072gitlab # [ 11.929328] gitaly[1386]: time="2026-07-06T10:54:05.795Z" level=info msg="using Git version" pid=1386 version=2.53.g1073gitlab # [ 11.932174] gitaly[1386]: time="2026-07-06T10:54:05.796Z" level=info msg="clearing disk cache object folder" pid=1386 storage=default1074gitlab # [ 11.935359] gitaly[1386]: time="2026-07-06T10:54:05.796Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3928464995 pid=1386 storage=default1075gitlab # [ 11.935799] gitaly[1386]: time="2026-07-06T10:54:05.796Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3928464995 pid=1386 storage=default1076gitlab # [ 11.937073] gitaly[1386]: time="2026-07-06T10:54:05.796Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=13861077gitlab # [ 11.937815] gitaly[1386]: time="2026-07-06T10:54:05.796Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=13861078gitlab # [ 11.938966] gitaly[1386]: time="2026-07-06T10:54:05.796Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3928464995 clear_duration_ms=0 pid=1386 storage=default1079gitlab # [ 11.997742] gitaly[1386]: time="2026-07-06T10:54:05.867Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=13861080gitlab # [ 11.998326] gitaly[1386]: time="2026-07-06T10:54:05.867Z" level=info msg="counting repositories" pid=13861081gitlab # [ 11.999256] gitaly[1386]: time="2026-07-06T10:54:05.867Z" level=info msg="starting to count repositories" pid=1386 storage_path=/var/gitlab/state/repositories1082gitlab # [ 11.999923] gitaly[1386]: time="2026-07-06T10:54:05.867Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=1386 storage_path=/var/gitlab/state/repositories1083gitlab # [ 12.001261] gitaly[1386]: time="2026-07-06T10:54:05.867Z" level=info msg="completed counting all repositories" counting_duration=0 pid=13861084gitlab # [ 12.002246] gitaly[1386]: time="2026-07-06T10:54:05.867Z" level=info msg="finished tempdir cleaner walk" pid=1386 storage=default time_ms=01085gitlab # [ 12.003261] gitaly[1386]: time="2026-07-06T10:54:05.867Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=1386 schema=unix1086gitlab # [ 12.004278] gitaly[1386]: time="2026-07-06T10:54:05.868Z" level=info msg="listening at address" address=/run/gitaly/gitaly-1386/sock.d/intern pid=1386 schema=unix1087gitlab # [ 12.025712] gitaly[1386]: time="2026-07-06T10:54:05.895Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=13861088gitlab # [ 12.026280] gitaly[1386]: time="2026-07-06T10:54:05.896Z" level=info msg="Started Gitaly" duration_ms=311 pid=13861089gitlab # [ 12.029472] gitaly[1386]: time="2026-07-06T10:54:05.899Z" level=info msg="maintenance: daily scheduled" pid=1386 scheduled="2026-07-06 12:00:00 +0000 UTC"1090gitlab # [ 12.404980] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1389]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1091gitlab # [ 12.408923] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1389]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1092gitlab # [ 12.435934] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1389]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1093gitlab # [ 13.974336] gitaly[1386]: time="2026-07-06T10:54:07.843Z" level=info msg="License database preloaded" duration_ms=2257 pid=13861094gitlab # [ 14.980302] dhcpcd[1228]: eth0: leased 10.0.2.15 for 86400 seconds1095gitlab # [ 14.982367] dhcpcd[1228]: eth0: adding route to 10.0.2.0/241096gitlab # [ 14.984917] dhcpcd[1228]: eth0: adding default route via 10.0.2.21097gitlab # [ 15.126247] systemd[1]: Started DHCP Client.1098gitlab # [ 15.131275] systemd[1]: Reached target Network is Online.1099gitlab # [ 43.936646] postgres[1756]: [1756] ERROR: relation "feature_gates" does not exist at character 5231100gitlab # [ 43.942772] postgres[1756]: [1756] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1101gitlab # [ 43.948129] postgres[1756]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1102gitlab # [ 43.953729] postgres[1756]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1103gitlab # [ 43.958867] postgres[1756]: attidentity AS identity,1104gitlab # [ 43.962859] postgres[1756]: attgenerated as attgenerated1105gitlab # [ 43.966955] postgres[1756]: FROM pg_attribute a1106gitlab # [ 43.970538] postgres[1756]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1107gitlab # [ 43.976223] postgres[1756]: LEFT JOIN pg_type t ON a.atttypid = t.oid1108gitlab # [ 43.980467] postgres[1756]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1109gitlab # [ 43.986550] postgres[1756]: WHERE a.attrelid = '"feature_gates"'::regclass1110gitlab # [ 43.990086] postgres[1756]: AND a.attnum > 0 AND NOT a.attisdropped1111gitlab # [ 43.993390] postgres[1756]: ORDER BY a.attnum1112gitlab # [ 43.995996] postgres[1756]:1113gitlab # [ 44.149736] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1389]: W, [2026-07-06T10:54:38.018547 #1389] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1114gitlab # [ 49.586181] gitlab-workhorse[1287]: time="2026-07-06T10:54:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1115gitlab # [ 50.059208] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1811]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1116gitlab # [ 50.067442] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1811]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1117gitlab # [ 59.587099] gitlab-workhorse[1287]: time="2026-07-06T10:54:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1118gitlab # [ 67.874174] postgres[1895]: [1895] ERROR: relation "table_without_models" does not exist1119gitlab # [ 67.875437] postgres[1895]: [1895] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1120gitlab # [ 69.598566] gitlab-workhorse[1287]: time="2026-07-06T10:55:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 79.608166] gitlab-workhorse[1287]: time="2026-07-06T10:55:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 82.934983] systemd[1]: Finished gitlab-db-config.service.1123gitlab # [ 82.947272] systemd[1]: Started gitlab-sidekiq.service.1124gitlab # [ 82.953720] systemd[1]: Starting gitlab.service...1125gitlab # [ 83.318209] bundle[2099]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1126gitlab # [ 83.326673] bundle[2099]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1127gitlab # [ 83.334765] bundle[2099]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1128gitlab # [ 86.288138] sidekiq-cluster[2097]: {"severity":"INFO","time":"2026-07-06T10:55:20.139Z","message":"Starting cluster with 1 processes"}1129gitlab # [ 86.607124] bundle[2099]: {"timestamp":"2026-07-06T10:55:20.451Z","pid":2099,"message":"* Enabling systemd notification integration"}1130gitlab # [ 86.613707] bundle[2099]: {"timestamp":"2026-07-06T10:55:20.475Z","pid":2099,"message":"Puma starting in cluster mode..."}1131gitlab # [ 86.619653] bundle[2099]: {"timestamp":"2026-07-06T10:55:20.475Z","pid":2099,"message":"* Puma version: 7.2.0 (\"On The Corner\")"}1132gitlab # [ 86.626284] bundle[2099]: {"timestamp":"2026-07-06T10:55:20.475Z","pid":2099,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1133gitlab # [ 86.634328] bundle[2099]: {"timestamp":"2026-07-06T10:55:20.475Z","pid":2099,"message":"* Min threads: 0"}1134gitlab # [ 86.639665] bundle[2099]: {"timestamp":"2026-07-06T10:55:20.476Z","pid":2099,"message":"* Max threads: 4"}1135gitlab # [ 86.645141] bundle[2099]: {"timestamp":"2026-07-06T10:55:20.476Z","pid":2099,"message":"* Environment: production"}1136gitlab # [ 86.650858] bundle[2099]: {"timestamp":"2026-07-06T10:55:20.476Z","pid":2099,"message":"* Master PID: 2099"}1137gitlab # [ 86.656548] bundle[2099]: {"timestamp":"2026-07-06T10:55:20.476Z","pid":2099,"message":"* Workers: 2"}1138gitlab # [ 86.660756] bundle[2099]: {"timestamp":"2026-07-06T10:55:20.476Z","pid":2099,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1139gitlab # [ 86.666104] bundle[2099]: {"timestamp":"2026-07-06T10:55:20.476Z","pid":2099,"message":"* Preloading application"}1140gitlab # [ 89.618920] gitlab-workhorse[1287]: time="2026-07-06T10:55:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1141gitlab # [ 99.621358] gitlab-workhorse[1287]: time="2026-07-06T10:55:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 109.622657] gitlab-workhorse[1287]: time="2026-07-06T10:55:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 112.768474] bundle[2099]: W, [2026-07-06T10:55:46.637394 #2099] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1144gitlab # [ 114.045422] sidekiq-cluster[2138]: 2026-07-06T10:55:47.914Z pid=2138 tid=tzm INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2138, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430182400}1145gitlab # [ 114.237530] sidekiq-cluster[2138]: W, [2026-07-06T10:55:48.107122 #2138] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 114.282221] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:48.151Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1147gitlab # [ 116.250586] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.119Z","message":"GitLab reliable fetch activated!"}1148gitlab # [ 116.252683] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.119Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1149gitlab # [ 116.286437] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.156Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1150gitlab # [ 116.294774] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.164Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1151gitlab # [ 116.301944] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.171Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1152gitlab # [ 116.309326] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.179Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1153gitlab # [ 116.317253] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.186Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1154gitlab # [ 116.325194] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.194Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1155gitlab # [ 116.332245] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.201Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1156gitlab # [ 116.339219] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.208Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1157gitlab # [ 116.346471] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.216Z","message":"Cron Jobs - added job with name expire_build_artifacts_worker in the namespace default"}1158gitlab # [ 116.353784] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.223Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1159gitlab # [ 116.360173] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.229Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1160gitlab # [ 116.367688] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.237Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1161gitlab # [ 116.373907] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.243Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1162gitlab # [ 116.379730] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.249Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1163gitlab # [ 116.385550] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.255Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1164gitlab # [ 116.389526] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.259Z","message":"Cron Jobs - added job with name environments_auto_delete_cron_worker in the namespace default"}1165gitlab # [ 116.393905] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.263Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1166gitlab # [ 116.398441] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.268Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1167gitlab # [ 116.402973] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.272Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1168gitlab # [ 116.407505] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.277Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1169gitlab # [ 116.412105] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.282Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1170gitlab # [ 116.415270] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.285Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1171gitlab # [ 116.418824] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.288Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1172gitlab # [ 116.422579] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.292Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1173gitlab # [ 116.426242] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.296Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1174gitlab # [ 116.429326] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.299Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1175gitlab # [ 116.432886] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.302Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1176gitlab # [ 116.436671] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.306Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1177gitlab # [ 116.439834] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.309Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1178gitlab # [ 116.443211] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.313Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1179gitlab # [ 116.446727] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.316Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1180gitlab # [ 116.449874] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.319Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1181gitlab # [ 116.453181] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.323Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1182gitlab # [ 116.456666] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.326Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1183gitlab # [ 116.460617] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.330Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1184gitlab # [ 116.463635] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.333Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1185gitlab # [ 116.467119] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.337Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1186gitlab # [ 116.470370] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.340Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1187gitlab # [ 116.473583] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.343Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1188gitlab # [ 116.476735] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.346Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1189gitlab # [ 116.480226] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.350Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1190gitlab # [ 116.483261] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.353Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1191gitlab # [ 116.486518] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.356Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1192gitlab # [ 116.490211] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.360Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1193gitlab # [ 116.493646] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.363Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1194gitlab # [ 116.497355] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.367Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1195gitlab # [ 116.500221] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.370Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1196gitlab # [ 116.503495] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.373Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1197gitlab # [ 116.507207] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.377Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1198gitlab # [ 116.510854] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.380Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1199gitlab # [ 116.514202] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.384Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1200gitlab # [ 116.517594] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.387Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1201gitlab # [ 116.521230] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.391Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1202gitlab # [ 116.531167] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.401Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1203gitlab # [ 116.534524] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.404Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1204gitlab # [ 116.538355] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.408Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1205gitlab # [ 116.541766] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.411Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1206gitlab # [ 116.545325] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.415Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1207gitlab # [ 116.548643] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.418Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1208gitlab # [ 116.552091] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.422Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1209gitlab # [ 116.555517] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.425Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1210gitlab # [ 116.559169] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.429Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1211gitlab # [ 116.561826] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.431Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1212gitlab # [ 116.565826] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.435Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1213gitlab # [ 116.569176] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.439Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1214gitlab # [ 116.572498] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.442Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1215gitlab # [ 116.576814] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.446Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1216gitlab # [ 116.601611] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.471Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1217gitlab # [ 116.604414] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.474Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1218gitlab # [ 116.607453] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.477Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1219gitlab # [ 116.610789] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.480Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1220gitlab # [ 116.615122] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.485Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1221gitlab # [ 116.618054] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.487Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1222gitlab # [ 116.621562] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.491Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1223gitlab # [ 116.624863] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.494Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1224gitlab # [ 116.627989] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.497Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1225gitlab # [ 116.631658] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.501Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1226gitlab # [ 116.635147] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.505Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1227gitlab # [ 116.638647] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.508Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1228gitlab # [ 116.641878] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.511Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1229gitlab # [ 116.645749] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.515Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1230gitlab # [ 116.648846] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.518Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1231gitlab # [ 116.652751] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.522Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1232gitlab # [ 116.655962] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.525Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1233gitlab # [ 116.659820] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.529Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1234gitlab # [ 116.662973] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.532Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1235gitlab # [ 116.666834] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.536Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1236gitlab # [ 116.670589] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.540Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1237gitlab # [ 116.690265] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.560Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1238gitlab # [ 116.692886] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.562Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1239gitlab # [ 116.696866] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.566Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1240gitlab # [ 116.700033] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.569Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1241gitlab # [ 116.703730] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.573Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1242gitlab # [ 116.706811] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.576Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1243gitlab # [ 116.710322] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.580Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1244gitlab # [ 116.713954] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.583Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1245gitlab # [ 116.718184] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.588Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1246gitlab # [ 116.721054] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.590Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1247gitlab # [ 116.724084] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.594Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1248gitlab # [ 116.735637] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.605Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1249gitlab # [ 116.738372] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.608Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1250gitlab # [ 116.741712] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.611Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1251gitlab # [ 116.745993] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.615Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1252gitlab # [ 116.749945] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.619Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1253gitlab # [ 116.753263] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.623Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1254gitlab # [ 116.756497] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.626Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1255gitlab # [ 116.759880] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.629Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1256gitlab # [ 116.763572] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.633Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1257gitlab # [ 116.767987] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.637Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1258gitlab # [ 116.770616] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:55:50.640Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1259gitlab # [ 119.313648] sidekiq-cluster[2138]: InitializerConnections Query: SET client_min_messages TO 'warning'1260gitlab # [ 119.314934] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1261gitlab # [ 119.317486] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1262gitlab # [ 119.319186] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1263gitlab # [ 119.320538] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1264gitlab # [ 119.322304] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1265gitlab # [ 119.323924] sidekiq-cluster[2138]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1266gitlab # [ 119.327221] sidekiq-cluster[2138]: InitializerConnections Query: SET standard_conforming_strings = on1267gitlab # [ 119.328519] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1268gitlab # [ 119.335259] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1269gitlab # [ 119.337470] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1270gitlab # [ 119.339780] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1271gitlab # [ 119.341857] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1272gitlab # [ 119.344346] sidekiq-cluster[2138]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1273gitlab # [ 119.348524] sidekiq-cluster[2138]: InitializerConnections Query: SET intervalstyle = iso_86011274gitlab # [ 119.350482] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1275gitlab # [ 119.352878] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1276gitlab # [ 119.355093] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1277gitlab # [ 119.357400] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1278gitlab # [ 119.359453] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1279gitlab # [ 119.361895] sidekiq-cluster[2138]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1280gitlab # [ 119.364604] sidekiq-cluster[2138]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1281gitlab # [ 119.367633] sidekiq-cluster[2138]: FROM pg_type as t1282gitlab # [ 119.368977] sidekiq-cluster[2138]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1283gitlab # [ 119.371899] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1284gitlab # [ 119.374320] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1285gitlab # [ 119.376474] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1286gitlab # [ 119.378745] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1287gitlab # [ 119.380807] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1288gitlab # [ 119.383235] sidekiq-cluster[2138]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1289gitlab # [ 119.385880] sidekiq-cluster[2138]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1290gitlab # [ 119.387808] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1291gitlab # [ 119.390232] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1292gitlab # [ 119.392343] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1293gitlab # [ 119.394630] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1294gitlab # [ 119.396675] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1295gitlab # [ 119.399207] sidekiq-cluster[2138]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1296gitlab # [ 119.401909] sidekiq-cluster[2138]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics'1297gitlab # [ 119.407113] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1298gitlab # [ 119.409947] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1299gitlab # [ 119.412710] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1300gitlab # [ 119.413719] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1301gitlab # [ 119.414811] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1302gitlab # [ 119.418355] sidekiq-cluster[2138]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1303gitlab # [ 119.634223] gitlab-workhorse[1287]: time="2026-07-06T10:55:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1304gitlab # [ 129.636745] gitlab-workhorse[1287]: time="2026-07-06T10:56:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1305gitlab # [ 138.928363] sidekiq-cluster[2138]: InitializerConnections Query: SET client_min_messages TO 'warning'1306gitlab # [ 138.928598] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1307gitlab # [ 138.929649] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1308gitlab # [ 138.930710] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1309gitlab # [ 138.932137] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1310gitlab # [ 138.932961] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:145:in `disabled?'1311gitlab # [ 138.934091] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1312gitlab # [ 138.934879] sidekiq-cluster[2138]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1313gitlab # [ 138.936077] sidekiq-cluster[2138]: InitializerConnections Query: SET standard_conforming_strings = on1314gitlab # [ 138.936801] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1315gitlab # [ 138.937882] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1316gitlab # [ 138.939042] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1317gitlab # [ 138.939812] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1318gitlab # [ 138.940977] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:145:in `disabled?'1319gitlab # [ 138.942109] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1320gitlab # [ 138.942882] sidekiq-cluster[2138]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1321gitlab # [ 138.944054] sidekiq-cluster[2138]: InitializerConnections Query: SET intervalstyle = iso_86011322gitlab # [ 138.944821] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1323gitlab # [ 138.945940] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1324gitlab # [ 138.947071] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1325gitlab # [ 138.947881] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1326gitlab # [ 138.948971] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:145:in `disabled?'1327gitlab # [ 138.950077] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1328gitlab # [ 138.950955] sidekiq-cluster[2138]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1329gitlab # [ 138.952118] sidekiq-cluster[2138]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1330gitlab # [ 138.952868] sidekiq-cluster[2138]: FROM pg_type as t1331gitlab # [ 138.953989] sidekiq-cluster[2138]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1332gitlab # [ 138.954806] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1333gitlab # [ 138.955920] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1334gitlab # [ 138.957068] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1335gitlab # [ 138.957841] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1336gitlab # [ 138.958969] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:145:in `disabled?'1337gitlab # [ 138.960135] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1338gitlab # [ 138.960953] sidekiq-cluster[2138]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1339gitlab # [ 138.962114] sidekiq-cluster[2138]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1340gitlab # [ 138.962845] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1341gitlab # [ 138.963965] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1342gitlab # [ 138.965107] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1343gitlab # [ 138.965876] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1344gitlab # [ 138.966994] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:145:in `disabled?'1345gitlab # [ 138.967825] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1346gitlab # [ 138.968940] sidekiq-cluster[2138]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1347gitlab # [ 138.970056] sidekiq-cluster[2138]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'sidekiq_throttling_middleware'1348gitlab # [ 138.970837] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1349gitlab # [ 138.971995] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1350gitlab # [ 138.972801] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1351gitlab # [ 138.973903] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1352gitlab # [ 138.974992] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/feature.rb:145:in `disabled?'1353gitlab # [ 138.975832] sidekiq-cluster[2138]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1354gitlab # [ 138.976931] sidekiq-cluster[2138]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1355gitlab # [ 139.646824] gitlab-workhorse[1287]: time="2026-07-06T10:56:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1356gitlab # [ 140.470643] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:14.339Z","message":"Booted Rails 7.2.3 application in production environment"}1357gitlab # [ 140.479572] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:14.349Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1358gitlab # [ 140.481962] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:14.349Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1359gitlab # [ 140.485945] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:14.349Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1360gitlab # [ 140.505285] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:14.375Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1361gitlab # [ 141.531462] bundle[2099]: {"timestamp":"2026-07-06T10:56:15.400Z","pid":2099,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1362gitlab # [ 141.539782] bundle[2099]: {"timestamp":"2026-07-06T10:56:15.400Z","pid":2099,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1363gitlab # [ 141.546640] bundle[2099]: {"timestamp":"2026-07-06T10:56:15.400Z","pid":2099,"message":"! #\u003cThread:0x000070d43acb6400 /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1364gitlab # [ 141.566525] bundle[2099]: {"timestamp":"2026-07-06T10:56:15.400Z","pid":2099,"message":"! #\u003cThread:0x000070d43aee0bb8 /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1365gitlab # [ 141.583628] bundle[2099]: {"timestamp":"2026-07-06T10:56:15.401Z","pid":2099,"message":"Use Ctrl-C to stop"}1366gitlab # [ 141.587847] bundle[2099]: {"timestamp":"2026-07-06T10:56:15.401Z","pid":2099,"message":"Sending status to systemd every 1.0 sec"}1367gitlab # [ 141.950189] bundle[2099]: {"timestamp":"2026-07-06T10:56:15.819Z","pid":2099,"message":"- Worker 0 (PID: 2660) booted in 0.38s, phase: 0"}1368gitlab # [ 141.964401] bundle[2099]: {"timestamp":"2026-07-06T10:56:15.834Z","pid":2099,"message":"- Worker 1 (PID: 2664) booted in 0.36s, phase: 0"}1369gitlab # [ 141.973654] systemd[1]: Started gitlab.service.1370gitlab # [ 141.974876] systemd[1]: Reached target Common target for all GitLab services..1371gitlab # [ 141.979880] systemd[1]: Starting setup-gitlab.service...1372gitlab # [ 141.998101] setup-gitlab-start[2697]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1373gitlab # [ 142.128752] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:15.997Z","message":"Cleaning working queues"}1374gitlab # [ 142.136151] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:16.005Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"513a89e92c968ad82640a5b4","created_at":"2026-07-06T10:55:16.205Z","trace_propagation_headers":{"sentry-trace":"b2f204fac11a44efa1b4e50096711636-373bf0d4795e4576","baggage":"sentry-trace_id=b2f204fac11a44efa1b4e50096711636,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"aa415100f7330fd1baa5f054c797a122","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-06T10:55:16.220Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-513a89e92c968ad82640a5b4: start","job_status":"start","queue_duration_s":59.784896,"scheduling_latency_s":59.784964}1375gitlab # [ 142.370283] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:16.239Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"513a89e92c968ad82640a5b4","created_at":"2026-07-06T10:55:16.205Z","trace_propagation_headers":{"sentry-trace":"b2f204fac11a44efa1b4e50096711636-373bf0d4795e4576","baggage":"sentry-trace_id=b2f204fac11a44efa1b4e50096711636,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"aa415100f7330fd1baa5f054c797a122","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-06T10:55:16.220Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-513a89e92c968ad82640a5b4: done: 0.234157 sec","job_status":"done","queue_duration_s":59.784896,"scheduling_latency_s":59.784964,"redis_calls":24,"redis_duration_s":0.011289,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005747,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003354,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002188,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09474193,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.234157,"completed_at":"2026-07-06T10:56:16.239Z","load_balancing_strategy":"primary","db_duration_s":0.071905,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1376gitlab # [ 144.617822] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:56:18 +0000] "GET /users/sign_in HTTP/1.1" 200 10624 "" "curl/8.20.0" 25911377gitlab # [ 144.626519] setup-gitlab-start[2724]: ++ jq -r .access_token1378gitlab # [ 144.628343] setup-gitlab-start[2723]: ++ curl -fs -X POST -H 'Content-Type: application/json' -d '{"grant_type":"password","username":"root","password":"notproduction"}' http://gitlab/oauth/token1379gitlab # [ 145.403296] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:56:19 +0000] "POST /oauth/token HTTP/1.1" 200 244 "" "curl/8.20.0" 7551380gitlab # [ 145.409578] setup-gitlab-start[2697]: + BEARER=0344aa8f770a0a13a6924861f266400da8eebf78bdb6409e2783becf72605d571381gitlab # [ 145.410577] setup-gitlab-start[2697]: + AUTH='Authorization: Bearer 0344aa8f770a0a13a6924861f266400da8eebf78bdb6409e2783becf72605d57'1382gitlab # [ 145.412371] setup-gitlab-start[2697]: + curl -fs -X PUT -H 'Authorization: Bearer 0344aa8f770a0a13a6924861f266400da8eebf78bdb6409e2783becf72605d57' 'http://gitlab/api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true'1383gitlab # [ 146.795770] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:56:20 +0000] "PUT /api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true HTTP/1.1" 200 17133 "" "curl/8.20.0" 13661384gitlab # [ 146.808128] setup-gitlab-start[2697]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner Rails.cache.clear1385gitlab # [ 146.830367] runuser[2748]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1386gitlab # [ 147.206607] setup-gitlab-start[2749]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1387gitlab # [ 147.207340] setup-gitlab-start[2749]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1388gitlab # [ 147.210131] setup-gitlab-start[2749]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1389gitlab # [ 147.789557] setup-gitlab-start[2749]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1390gitlab # [ 147.790327] setup-gitlab-start[2749]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1391gitlab # [ 147.793563] setup-gitlab-start[2749]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1392gitlab # [ 153.329337] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:27.196Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"812d87762f76185da3ac8fe4","created_at":"2026-07-06T10:56:27.166Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e61809001de11f67bdca025360a9c66f","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.193Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-812d87762f76185da3ac8fe4: start","job_status":"start","queue_duration_s":0.003325,"scheduling_latency_s":0.003399}1393gitlab # [ 153.425451] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:27.294Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"812d87762f76185da3ac8fe4","created_at":"2026-07-06T10:56:27.166Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e61809001de11f67bdca025360a9c66f","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.193Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-812d87762f76185da3ac8fe4: done: 0.098278 sec","job_status":"done","queue_duration_s":0.003325,"scheduling_latency_s":0.003399,"redis_calls":12,"redis_duration_s":0.034756999999999996,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.004548,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.017432,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008309,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001215797,"duration_s":0.098278,"completed_at":"2026-07-06T10:56:27.294Z","load_balancing_strategy":"primary","db_duration_s":0.001313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 153.528879] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:27.398Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"497b4e6593502035fb01d940","created_at":"2026-07-06T10:56:27.222Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e20a5eb1df1c73243f39b6eea98abd96","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.246Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-497b4e6593502035fb01d940: start","job_status":"start","queue_duration_s":0.151301,"scheduling_latency_s":0.151364}1395gitlab # [ 153.618156] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:27.487Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"497b4e6593502035fb01d940","created_at":"2026-07-06T10:56:27.222Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e20a5eb1df1c73243f39b6eea98abd96","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.246Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-497b4e6593502035fb01d940: done: 0.089707 sec","job_status":"done","queue_duration_s":0.151301,"scheduling_latency_s":0.151364,"redis_calls":13,"redis_duration_s":0.015876,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.008113,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004807,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002956,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.018781716,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.089707,"completed_at":"2026-07-06T10:56:27.487Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01173,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1396gitlab # [ 153.620665] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:27.490Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"dce050590a377a5461fa13d8","created_at":"2026-07-06T10:56:27.273Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58cad21239357c3b4b5a73e16ae2bab6","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.285Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-dce050590a377a5461fa13d8: start","job_status":"start","queue_duration_s":0.204602,"scheduling_latency_s":0.204623}1397gitlab # [ 153.852687] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:27.721Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"dce050590a377a5461fa13d8","created_at":"2026-07-06T10:56:27.273Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58cad21239357c3b4b5a73e16ae2bab6","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.285Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-dce050590a377a5461fa13d8: done: 0.231146 sec","job_status":"done","queue_duration_s":0.204602,"scheduling_latency_s":0.204623,"redis_calls":16,"redis_duration_s":0.021589999999999998,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.012646,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005313,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003631,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.137,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.137,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00152673,"duration_s":0.231146,"completed_at":"2026-07-06T10:56:27.721Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.14953,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 153.941722] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:27.810Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"dcbeef31d632b04618449621","created_at":"2026-07-06T10:56:27.393Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"287e49cf2999bc1f5dfa4db25b22e584","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.411Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-dcbeef31d632b04618449621: start","job_status":"start","queue_duration_s":0.399132,"scheduling_latency_s":0.399206}1399gitlab # [ 154.028127] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:27.897Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1400gitlab # [ 154.059128] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:27.928Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"dcbeef31d632b04618449621","created_at":"2026-07-06T10:56:27.393Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"287e49cf2999bc1f5dfa4db25b22e584","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.411Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-dcbeef31d632b04618449621: done: 0.117483 sec","job_status":"done","queue_duration_s":0.399132,"scheduling_latency_s":0.399206,"redis_calls":10,"redis_duration_s":0.015537,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00185,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00956,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004127,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001005436,"duration_s":0.117483,"completed_at":"2026-07-06T10:56:27.927Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001304,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 154.066936] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:27.936Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"dbc19e11af6a82bde6921c85","created_at":"2026-07-06T10:56:27.442Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10528ca6dcfbf824ebdd3a55ad1c867f","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.598Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-dbc19e11af6a82bde6921c85: start","job_status":"start","queue_duration_s":0.337357,"scheduling_latency_s":0.337422}1402gitlab # [ 154.146638] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:27.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"dbc19e11af6a82bde6921c85","created_at":"2026-07-06T10:56:27.442Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10528ca6dcfbf824ebdd3a55ad1c867f","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.598Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-dbc19e11af6a82bde6921c85: done: 0.048978 sec","job_status":"done","queue_duration_s":0.337357,"scheduling_latency_s":0.337422,"redis_calls":10,"redis_duration_s":0.006013,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00109,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003816,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000832229,"duration_s":0.048978,"completed_at":"2026-07-06T10:56:27.984Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005603,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 154.157940] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:27.987Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"228831699041b11d39b7c0bd","created_at":"2026-07-06T10:56:27.646Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d90617de3fdb4d7346a087093ceb9c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.665Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-228831699041b11d39b7c0bd: start","job_status":"start","queue_duration_s":0.321945,"scheduling_latency_s":0.321966}1404gitlab # [ 154.580771] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:28.449Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"228831699041b11d39b7c0bd","created_at":"2026-07-06T10:56:27.646Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d90617de3fdb4d7346a087093ceb9c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.665Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-228831699041b11d39b7c0bd: done: 0.462355 sec","job_status":"done","queue_duration_s":0.321945,"scheduling_latency_s":0.321966,"redis_calls":12,"redis_duration_s":0.005261999999999999,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000784,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002534,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001944,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.228479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000773562,"exclusive_lock_hold_duration_s":0.42968952800000004,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.462355,"completed_at":"2026-07-06T10:56:28.449Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017268,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 154.683287] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:28.552Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"28f9dd6bc48a07bfe2f4386a","created_at":"2026-07-06T10:56:27.686Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51e26fc6a392b4e7996518f906913f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-06T10:56:27.706Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-28f9dd6bc48a07bfe2f4386a: start","job_status":"start","queue_duration_s":0.846645,"scheduling_latency_s":0.846689}1406gitlab # [ 154.728396] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:28.597Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1407gitlab # [ 154.747665] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:28.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"28f9dd6bc48a07bfe2f4386a","created_at":"2026-07-06T10:56:27.686Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51e26fc6a392b4e7996518f906913f7f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-06T10:56:27.706Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-28f9dd6bc48a07bfe2f4386a: done: 0.064167 sec","job_status":"done","queue_duration_s":0.846645,"scheduling_latency_s":0.846689,"redis_calls":10,"redis_duration_s":0.006193000000000001,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000759,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004648,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000786,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000737245,"duration_s":0.064167,"completed_at":"2026-07-06T10:56:28.616Z","load_balancing_strategy":"primary","db_duration_s":0.000937,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 154.815235] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:28.684Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"b54b387e2987d359ea90d81f","created_at":"2026-07-06T10:56:27.804Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f701913a1fb5213638b8a856e501e260","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.843Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-b54b387e2987d359ea90d81f: start","job_status":"start","queue_duration_s":0.840513,"scheduling_latency_s":0.84056}1409gitlab # [ 154.874321] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:28.743Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1410gitlab # [ 154.893240] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:28.762Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"b54b387e2987d359ea90d81f","created_at":"2026-07-06T10:56:27.804Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f701913a1fb5213638b8a856e501e260","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.843Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-b54b387e2987d359ea90d81f: done: 0.078014 sec","job_status":"done","queue_duration_s":0.840513,"scheduling_latency_s":0.84056,"redis_calls":10,"redis_duration_s":0.006869999999999999,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001253,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004141,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001476,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000965486,"duration_s":0.078014,"completed_at":"2026-07-06T10:56:28.762Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001283,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 154.962300] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:28.831Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"77b9bb3e4bd0c4304ed48e48","created_at":"2026-07-06T10:56:27.855Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20a58ac07201f0082bca2e2eda0745df","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.885Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-77b9bb3e4bd0c4304ed48e48: start","job_status":"start","queue_duration_s":0.946242,"scheduling_latency_s":0.946311}1412gitlab # [ 155.038285] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:28.907Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"77b9bb3e4bd0c4304ed48e48","created_at":"2026-07-06T10:56:27.855Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20a58ac07201f0082bca2e2eda0745df","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:27.885Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-77b9bb3e4bd0c4304ed48e48: done: 0.076293 sec","job_status":"done","queue_duration_s":0.946242,"scheduling_latency_s":0.946311,"redis_calls":12,"redis_duration_s":0.0071660000000000005,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001196,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003103,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002867,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001741004,"exclusive_lock_hold_duration_s":0.012317488000000001,"duration_s":0.076293,"completed_at":"2026-07-06T10:56:28.907Z","load_balancing_strategy":"primary","db_duration_s":0.006225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 155.118469] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:28.987Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9d5f04ee4fdf1d8f37b28fd8","created_at":"2026-07-06T10:56:27.919Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"97a07e6fccbc80ad655e86135f771d87","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.127Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9d5f04ee4fdf1d8f37b28fd8: start","job_status":"start","queue_duration_s":0.859674,"scheduling_latency_s":0.859774}1414gitlab # [ 155.149880] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:29.019Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1415gitlab # [ 155.168419] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:29.037Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9d5f04ee4fdf1d8f37b28fd8","created_at":"2026-07-06T10:56:27.919Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"97a07e6fccbc80ad655e86135f771d87","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.127Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9d5f04ee4fdf1d8f37b28fd8: done: 0.050654 sec","job_status":"done","queue_duration_s":0.859674,"scheduling_latency_s":0.859774,"redis_calls":10,"redis_duration_s":0.009346,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001211,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00669,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001445,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000971911,"duration_s":0.050654,"completed_at":"2026-07-06T10:56:29.037Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 155.173115] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:29.042Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"4cdad322e689ff75755ee8ba","created_at":"2026-07-06T10:56:28.148Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47f74f70985e8c8c1f20d6ac43381fc7","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.163Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-4cdad322e689ff75755ee8ba: start","job_status":"start","queue_duration_s":0.878144,"scheduling_latency_s":0.878317}1417gitlab # [ 155.224153] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:29.093Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"4cdad322e689ff75755ee8ba","created_at":"2026-07-06T10:56:28.148Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47f74f70985e8c8c1f20d6ac43381fc7","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.163Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-4cdad322e689ff75755ee8ba: done: 0.051446 sec","job_status":"done","queue_duration_s":0.878144,"scheduling_latency_s":0.878317,"redis_calls":10,"redis_duration_s":0.005993,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001158,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003886,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001135619,"duration_s":0.051446,"completed_at":"2026-07-06T10:56:29.093Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00443,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 155.254103] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:29.095Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"e34c995f61dea206074ec73f","created_at":"2026-07-06T10:56:28.180Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2de7f0f88fc28f346693f38a239f6c06","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.189Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-e34c995f61dea206074ec73f: start","job_status":"start","queue_duration_s":0.905903,"scheduling_latency_s":0.905926}1419gitlab # [ 155.345115] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:29.214Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"e34c995f61dea206074ec73f","created_at":"2026-07-06T10:56:28.180Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2de7f0f88fc28f346693f38a239f6c06","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.189Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-e34c995f61dea206074ec73f: done: 0.118653 sec","job_status":"done","queue_duration_s":0.905903,"scheduling_latency_s":0.905926,"redis_calls":12,"redis_duration_s":0.003176,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000518,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001505,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001153,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000500622,"exclusive_lock_hold_duration_s":0.09688940900000001,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.118653,"completed_at":"2026-07-06T10:56:29.214Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014814,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1420gitlab # [ 155.349961] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:29.218Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c75bbdf9f97e9f01af25a5f0","created_at":"2026-07-06T10:56:28.196Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d45d287b43c017a25a5ec89ceedf0b7f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.205Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c75bbdf9f97e9f01af25a5f0: start","job_status":"start","queue_duration_s":1.012306,"scheduling_latency_s":1.012327}1421gitlab # [ 155.377387] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:29.246Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c75bbdf9f97e9f01af25a5f0","created_at":"2026-07-06T10:56:28.196Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d45d287b43c017a25a5ec89ceedf0b7f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.205Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c75bbdf9f97e9f01af25a5f0: done: 0.028522 sec","job_status":"done","queue_duration_s":1.012306,"scheduling_latency_s":1.012327,"redis_calls":12,"redis_duration_s":0.0030410000000000003,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001631,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000471848,"exclusive_lock_hold_duration_s":0.006934959,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.028522,"completed_at":"2026-07-06T10:56:29.246Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005831,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 155.472447] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:29.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0563c1e01c2a7b5a68a3ef22","created_at":"2026-07-06T10:56:28.213Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce651ebbcf0000024ee7e9c2ccbf520d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.219Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0563c1e01c2a7b5a68a3ef22: start","job_status":"start","queue_duration_s":1.02871,"scheduling_latency_s":1.028731}1423gitlab # [ 155.473867] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:29.263Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1424gitlab # [ 155.475331] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:29.269Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0563c1e01c2a7b5a68a3ef22","created_at":"2026-07-06T10:56:28.213Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce651ebbcf0000024ee7e9c2ccbf520d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.219Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0563c1e01c2a7b5a68a3ef22: done: 0.021256 sec","job_status":"done","queue_duration_s":1.02871,"scheduling_latency_s":1.028731,"redis_calls":10,"redis_duration_s":0.002317,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000464,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001364,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000489,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000346692,"duration_s":0.021256,"completed_at":"2026-07-06T10:56:29.269Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00411,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 155.543250] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:29.271Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"61fffe10b3496ea3e9ba6d4f","created_at":"2026-07-06T10:56:28.225Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7de5f9185f183f9c35e6f2d7e09efd9f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.230Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-61fffe10b3496ea3e9ba6d4f: start","job_status":"start","queue_duration_s":1.040701,"scheduling_latency_s":1.040721}1426gitlab # [ 155.883111] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:29.752Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"61fffe10b3496ea3e9ba6d4f","created_at":"2026-07-06T10:56:28.225Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7de5f9185f183f9c35e6f2d7e09efd9f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.230Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-61fffe10b3496ea3e9ba6d4f: done: 0.48095 sec","job_status":"done","queue_duration_s":1.040701,"scheduling_latency_s":1.040721,"redis_calls":574,"redis_duration_s":0.137379,"redis_read_bytes":573,"redis_write_bytes":49866,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000429,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001501,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.135449,"redis_shared_state_read_bytes":567,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.334987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000419327,"duration_s":0.48095,"completed_at":"2026-07-06T10:56:29.752Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 155.992529] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:29.861Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a6c8067f7f413f6f2d1fe458","created_at":"2026-07-06T10:56:28.233Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"435792a10118668f0a763abebccb12ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.239Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a6c8067f7f413f6f2d1fe458: start","job_status":"start","queue_duration_s":1.622199,"scheduling_latency_s":1.622277}1428gitlab # [ 156.081923] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:29.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a6c8067f7f413f6f2d1fe458","created_at":"2026-07-06T10:56:28.233Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"435792a10118668f0a763abebccb12ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.239Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a6c8067f7f413f6f2d1fe458: done: 0.089277 sec","job_status":"done","queue_duration_s":1.622199,"scheduling_latency_s":1.622277,"redis_calls":14,"redis_duration_s":0.009125000000000001,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002462,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003849,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002814,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00130659,"exclusive_lock_hold_duration_s":0.037296082,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.089277,"completed_at":"2026-07-06T10:56:29.950Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 156.178929] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.047Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7734bebc2a46d4e0549e92bb","created_at":"2026-07-06T10:56:28.244Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2104a9e29fa34f9c0b78dce68be5cb4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.249Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7734bebc2a46d4e0549e92bb: start","job_status":"start","queue_duration_s":1.797941,"scheduling_latency_s":1.798019}1430gitlab # [ 156.465521] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.334Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7734bebc2a46d4e0549e92bb","created_at":"2026-07-06T10:56:28.244Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2104a9e29fa34f9c0b78dce68be5cb4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.249Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7734bebc2a46d4e0549e92bb: done: 0.287044 sec","job_status":"done","queue_duration_s":1.797941,"scheduling_latency_s":1.798019,"redis_calls":14,"redis_duration_s":0.008271,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002353,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003327,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002591,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":125,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":125,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":125,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":80,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.056,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.19233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00120574,"exclusive_lock_hold_duration_s":0.238256539,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.287044,"completed_at":"2026-07-06T10:56:30.334Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.090157,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 156.575941] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.444Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ExpireBuildArtifactsWorker","jid":"9a1138c806676afcfc2fa4d0","created_at":"2026-07-06T10:56:28.256Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7908b06b3301224a9a757331aeab4e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:7be9ea93da0bda6381b334cf2932692b41842a57ea0aeac11899369225b9bb7e","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.261Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"ExpireBuildArtifactsWorker JID-9a1138c806676afcfc2fa4d0: start","job_status":"start","queue_duration_s":2.182923,"scheduling_latency_s":2.182995}1432gitlab # [ 156.638266] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.507Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ExpireBuildArtifactsWorker","jid":"9a1138c806676afcfc2fa4d0","created_at":"2026-07-06T10:56:28.256Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7908b06b3301224a9a757331aeab4e03","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:7be9ea93da0bda6381b334cf2932692b41842a57ea0aeac11899369225b9bb7e","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.261Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"ExpireBuildArtifactsWorker JID-9a1138c806676afcfc2fa4d0: done: 0.062959 sec","job_status":"done","queue_duration_s":2.182923,"scheduling_latency_s":2.182995,"redis_calls":10,"redis_duration_s":0.00406,"redis_read_bytes":9,"redis_write_bytes":1035,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000759,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002515,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000786,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000759035,"duration_s":0.062959,"completed_at":"2026-07-06T10:56:30.507Z","load_balancing_strategy":"primary","db_duration_s":0.001338,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 156.706953] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.574Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"b8e1b441cc9719e44d01c3cc","created_at":"2026-07-06T10:56:28.266Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da3f25a31ac1722dc9674100553a376e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-06T10:56:28.272Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-b8e1b441cc9719e44d01c3cc: start","job_status":"start","queue_duration_s":2.301603,"scheduling_latency_s":2.30166}1434gitlab # [ 156.737326] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.606Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"b8e1b441cc9719e44d01c3cc","created_at":"2026-07-06T10:56:28.266Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da3f25a31ac1722dc9674100553a376e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-06T10:56:28.272Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-b8e1b441cc9719e44d01c3cc: done: 0.033092 sec","job_status":"done","queue_duration_s":2.301603,"scheduling_latency_s":2.30166,"redis_calls":10,"redis_duration_s":0.00253,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000453,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001573,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000400889,"duration_s":0.033092,"completed_at":"2026-07-06T10:56:30.606Z","load_balancing_strategy":"primary","db_duration_s":0.002774,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 156.800296] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.608Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d1a42ce004d4d4deb1aa91b6","created_at":"2026-07-06T10:56:28.277Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d415831f4695909633575b664bbe686c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.283Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d1a42ce004d4d4deb1aa91b6: start","job_status":"start","queue_duration_s":2.325272,"scheduling_latency_s":2.325294}1436gitlab # [ 156.822652] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.629Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d1a42ce004d4d4deb1aa91b6","created_at":"2026-07-06T10:56:28.277Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d415831f4695909633575b664bbe686c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.283Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d1a42ce004d4d4deb1aa91b6: done: 0.021115 sec","job_status":"done","queue_duration_s":2.325272,"scheduling_latency_s":2.325294,"redis_calls":12,"redis_duration_s":0.003681,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001388,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001769,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000446984,"duration_s":0.021115,"completed_at":"2026-07-06T10:56:30.629Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000624,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 156.888061] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.631Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"3788f78d15d5b19f7ef22980","created_at":"2026-07-06T10:56:28.292Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b037153a0be768e8fd4fd6a4d8cad781","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.298Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-3788f78d15d5b19f7ef22980: start","job_status":"start","queue_duration_s":2.333001,"scheduling_latency_s":2.333024}1438gitlab # [ 156.909677] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.682Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"3788f78d15d5b19f7ef22980","created_at":"2026-07-06T10:56:28.292Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b037153a0be768e8fd4fd6a4d8cad781","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.298Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-3788f78d15d5b19f7ef22980: done: 0.050777 sec","job_status":"done","queue_duration_s":2.333001,"scheduling_latency_s":2.333024,"redis_calls":10,"redis_duration_s":0.003097,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001971,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000566,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000386362,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.050777,"completed_at":"2026-07-06T10:56:30.682Z","load_balancing_strategy":"primary","db_duration_s":0.02884,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 156.911155] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.683Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"396b07f957f52553d65927a3","created_at":"2026-07-06T10:56:28.302Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cb52a1d2d22b1e0efd59473236bcebc8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.309Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-396b07f957f52553d65927a3: start","job_status":"start","queue_duration_s":2.374751,"scheduling_latency_s":2.374774}1440gitlab # [ 156.993859] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.705Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"396b07f957f52553d65927a3","created_at":"2026-07-06T10:56:28.302Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cb52a1d2d22b1e0efd59473236bcebc8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.309Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-396b07f957f52553d65927a3: done: 0.02162 sec","job_status":"done","queue_duration_s":2.374751,"scheduling_latency_s":2.374774,"redis_calls":12,"redis_duration_s":0.0030080000000000003,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000485,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001431,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001092,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000498387,"exclusive_lock_hold_duration_s":0.003957486,"duration_s":0.02162,"completed_at":"2026-07-06T10:56:30.705Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 156.995460] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8a29001eb96f82a54b96ba87","created_at":"2026-07-06T10:56:28.322Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd28add9ec75749470ddcde408e445f4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.328Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8a29001eb96f82a54b96ba87: start","job_status":"start","queue_duration_s":2.378631,"scheduling_latency_s":2.378652}1442gitlab # [ 157.072126] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.735Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8a29001eb96f82a54b96ba87","created_at":"2026-07-06T10:56:28.322Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd28add9ec75749470ddcde408e445f4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.328Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8a29001eb96f82a54b96ba87: done: 0.028534 sec","job_status":"done","queue_duration_s":2.378631,"scheduling_latency_s":2.378652,"redis_calls":19,"redis_duration_s":0.004056,"redis_read_bytes":21,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000886,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000292,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002217,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000661,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049308,"duration_s":0.028534,"completed_at":"2026-07-06T10:56:30.735Z","load_balancing_strategy":"primary","db_duration_s":0.001522,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 157.141082] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.736Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"c6ad9bb5a100a78fee365bfb","created_at":"2026-07-06T10:56:28.335Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"1f20ebe79520b27f6bbba63251ebd9c8","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.341Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-c6ad9bb5a100a78fee365bfb: start","job_status":"start","queue_duration_s":2.39533,"scheduling_latency_s":2.395352}1444gitlab # [ 157.142399] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.753Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"c6ad9bb5a100a78fee365bfb","created_at":"2026-07-06T10:56:28.335Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"1f20ebe79520b27f6bbba63251ebd9c8","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.341Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-c6ad9bb5a100a78fee365bfb: done: 0.017179 sec","job_status":"done","queue_duration_s":2.39533,"scheduling_latency_s":2.395352,"redis_calls":10,"redis_duration_s":0.002284,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000486,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001368,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00043,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003872,"duration_s":0.017179,"completed_at":"2026-07-06T10:56:30.753Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000386,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 157.221299] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.755Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"323fe89be419c0828e67c519","created_at":"2026-07-06T10:56:28.346Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c51cf8012cc39e0b4502832ce4df04ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-06T10:56:28.353Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-323fe89be419c0828e67c519: start","job_status":"start","queue_duration_s":2.402215,"scheduling_latency_s":2.402236}1446gitlab # [ 157.222781] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.766Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1447gitlab # [ 157.223816] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.773Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"323fe89be419c0828e67c519","created_at":"2026-07-06T10:56:28.346Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c51cf8012cc39e0b4502832ce4df04ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-06T10:56:28.353Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-323fe89be419c0828e67c519: done: 0.017962 sec","job_status":"done","queue_duration_s":2.402215,"scheduling_latency_s":2.402236,"redis_calls":10,"redis_duration_s":0.002998,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000496,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001999,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000342502,"duration_s":0.017962,"completed_at":"2026-07-06T10:56:30.773Z","load_balancing_strategy":"primary","db_duration_s":0.000389,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 157.292473] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.774Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"df3b27c14bf1311a2255f726","created_at":"2026-07-06T10:56:28.359Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19382301ed0507cb377ba849b93bd826","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.365Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-df3b27c14bf1311a2255f726: start","job_status":"start","queue_duration_s":2.409112,"scheduling_latency_s":2.409132}1449gitlab # [ 157.294215] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.802Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"df3b27c14bf1311a2255f726","created_at":"2026-07-06T10:56:28.359Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19382301ed0507cb377ba849b93bd826","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.365Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-df3b27c14bf1311a2255f726: done: 0.027668 sec","job_status":"done","queue_duration_s":2.409112,"scheduling_latency_s":2.409132,"redis_calls":10,"redis_duration_s":0.008801999999999999,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001359,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003257,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004186,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000353956,"duration_s":0.027668,"completed_at":"2026-07-06T10:56:30.802Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 157.379048] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.803Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"54a7476d4a8813007bc4bfd7","created_at":"2026-07-06T10:56:28.373Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.379Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-54a7476d4a8813007bc4bfd7: start","job_status":"start","queue_duration_s":2.42391,"scheduling_latency_s":2.423931}1451gitlab # [ 157.380322] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.903Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"54a7476d4a8813007bc4bfd7","created_at":"2026-07-06T10:56:28.373Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-06T10:56:28.379Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-54a7476d4a8813007bc4bfd7: done: 0.099821 sec","job_status":"done","queue_duration_s":2.42391,"scheduling_latency_s":2.423931,"redis_calls":71,"redis_duration_s":0.023199,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002258,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000774,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.019508,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000659,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000410108,"duration_s":0.099821,"completed_at":"2026-07-06T10:56:30.903Z","load_balancing_strategy":"primary","db_duration_s":0.001671,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 157.428299] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.905Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"39b0202319988c5e76914e1f","created_at":"2026-07-06T10:56:30.719Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-26871d29a10a4bac","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bd28add9ec75749470ddcde408e445f4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.729Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-39b0202319988c5e76914e1f: start","job_status":"start","queue_duration_s":0.176472,"scheduling_latency_s":0.176496}1453gitlab # [ 157.504942] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.921Z","message":"No existing merge request to be cleaned up."}1454gitlab # [ 157.506243] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.932Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"39b0202319988c5e76914e1f","created_at":"2026-07-06T10:56:30.719Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-26871d29a10a4bac","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bd28add9ec75749470ddcde408e445f4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.729Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-39b0202319988c5e76914e1f: done: 0.026878 sec","job_status":"done","queue_duration_s":0.176472,"scheduling_latency_s":0.176496,"redis_calls":13,"redis_duration_s":0.003268,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000485,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001185,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001598,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000387759,"duration_s":0.026878,"completed_at":"2026-07-06T10:56:30.932Z","load_balancing_strategy":"primary","db_duration_s":0.00331,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 157.511527] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.933Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"603bfc1628cd1a65401d50f9","created_at":"2026-07-06T10:56:30.719Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-26871d29a10a4bac","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bd28add9ec75749470ddcde408e445f4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.729Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-603bfc1628cd1a65401d50f9: start","job_status":"start","queue_duration_s":0.204786,"scheduling_latency_s":0.204806}1456gitlab # [ 157.595352] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.947Z","message":"No existing merge request to be cleaned up."}1457gitlab # [ 157.596983] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.953Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"603bfc1628cd1a65401d50f9","created_at":"2026-07-06T10:56:30.719Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-26871d29a10a4bac","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bd28add9ec75749470ddcde408e445f4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.729Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-603bfc1628cd1a65401d50f9: done: 0.019538 sec","job_status":"done","queue_duration_s":0.204786,"scheduling_latency_s":0.204806,"redis_calls":10,"redis_duration_s":0.005594999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004715,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019538,"completed_at":"2026-07-06T10:56:30.953Z","load_balancing_strategy":"primary","db_duration_s":0.001641,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 157.598818] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.954Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"02c7f4de91952bc6448315e2","created_at":"2026-07-06T10:56:30.719Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-26871d29a10a4bac","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bd28add9ec75749470ddcde408e445f4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.729Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-02c7f4de91952bc6448315e2: start","job_status":"start","queue_duration_s":0.225821,"scheduling_latency_s":0.225844}1459gitlab # [ 157.666060] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.964Z","message":"No existing merge request to be cleaned up."}1460gitlab # [ 157.667132] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.970Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"02c7f4de91952bc6448315e2","created_at":"2026-07-06T10:56:30.719Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-26871d29a10a4bac","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bd28add9ec75749470ddcde408e445f4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.729Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-02c7f4de91952bc6448315e2: done: 0.015776 sec","job_status":"done","queue_duration_s":0.225821,"scheduling_latency_s":0.225844,"redis_calls":10,"redis_duration_s":0.002382,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001501,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015776,"completed_at":"2026-07-06T10:56:30.970Z","load_balancing_strategy":"primary","db_duration_s":0.001461,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 157.673120] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.972Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bb66f0d71163f063a6b09291","created_at":"2026-07-06T10:56:30.719Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-26871d29a10a4bac","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bd28add9ec75749470ddcde408e445f4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.729Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bb66f0d71163f063a6b09291: start","job_status":"start","queue_duration_s":0.243012,"scheduling_latency_s":0.243034}1462gitlab # [ 157.692419] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.981Z","message":"No existing merge request to be cleaned up."}1463gitlab # [ 157.694954] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.987Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bb66f0d71163f063a6b09291","created_at":"2026-07-06T10:56:30.719Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-26871d29a10a4bac","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bd28add9ec75749470ddcde408e445f4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.729Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bb66f0d71163f063a6b09291: done: 0.01585 sec","job_status":"done","queue_duration_s":0.243012,"scheduling_latency_s":0.243034,"redis_calls":10,"redis_duration_s":0.002437,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001483,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01585,"completed_at":"2026-07-06T10:56:30.987Z","load_balancing_strategy":"primary","db_duration_s":0.001565,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 157.764098] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:30.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"773a60451f0cb5cc15e055c2","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-773a60451f0cb5cc15e055c2: start","job_status":"start","queue_duration_s":0.094338,"scheduling_latency_s":0.094359}1465gitlab # [ 157.772064] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"773a60451f0cb5cc15e055c2","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-773a60451f0cb5cc15e055c2: done: 0.021025 sec","job_status":"done","queue_duration_s":0.094338,"scheduling_latency_s":0.094359,"redis_calls":16,"redis_duration_s":0.003658,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000476,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002127,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013013,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000353956,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021025,"completed_at":"2026-07-06T10:56:31.010Z","load_balancing_strategy":"primary","db_duration_s":0.000374,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 157.854160] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8587df70e1225f6a95416843","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8587df70e1225f6a95416843: start","job_status":"start","queue_duration_s":0.118562,"scheduling_latency_s":0.118582}1467gitlab # [ 157.855550] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8587df70e1225f6a95416843","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8587df70e1225f6a95416843: done: 0.018484 sec","job_status":"done","queue_duration_s":0.118562,"scheduling_latency_s":0.118582,"redis_calls":13,"redis_duration_s":0.005431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002253,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003178,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018484,"completed_at":"2026-07-06T10:56:31.032Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 157.928471] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7e71ab3f91d4859c272a3bb","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7e71ab3f91d4859c272a3bb: start","job_status":"start","queue_duration_s":0.138521,"scheduling_latency_s":0.138543}1469gitlab # [ 157.931856] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7e71ab3f91d4859c272a3bb","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7e71ab3f91d4859c272a3bb: done: 0.015358 sec","job_status":"done","queue_duration_s":0.138521,"scheduling_latency_s":0.138543,"redis_calls":13,"redis_duration_s":0.002939,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015358,"completed_at":"2026-07-06T10:56:31.048Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 158.005041] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4fcfc23a13f63ccac077a0e","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4fcfc23a13f63ccac077a0e: start","job_status":"start","queue_duration_s":0.155358,"scheduling_latency_s":0.155381}1471gitlab # [ 158.010728] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4fcfc23a13f63ccac077a0e","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4fcfc23a13f63ccac077a0e: done: 0.015539 sec","job_status":"done","queue_duration_s":0.155358,"scheduling_latency_s":0.155381,"redis_calls":13,"redis_duration_s":0.002953,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015539,"completed_at":"2026-07-06T10:56:31.065Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 158.077311] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64f8195ff129fd828f1e1494","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64f8195ff129fd828f1e1494: start","job_status":"start","queue_duration_s":0.17237,"scheduling_latency_s":0.172391}1473gitlab # [ 158.088816] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64f8195ff129fd828f1e1494","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64f8195ff129fd828f1e1494: done: 0.015854 sec","job_status":"done","queue_duration_s":0.17237,"scheduling_latency_s":0.172391,"redis_calls":13,"redis_duration_s":0.003051,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002144,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015854,"completed_at":"2026-07-06T10:56:31.083Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 158.156166] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba5e640bbe47e10bac6d165a","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba5e640bbe47e10bac6d165a: start","job_status":"start","queue_duration_s":0.189637,"scheduling_latency_s":0.189658}1475gitlab # [ 158.228072] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba5e640bbe47e10bac6d165a","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba5e640bbe47e10bac6d165a: done: 0.019882 sec","job_status":"done","queue_duration_s":0.189637,"scheduling_latency_s":0.189658,"redis_calls":13,"redis_duration_s":0.004479,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001859,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00262,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019882,"completed_at":"2026-07-06T10:56:31.104Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 158.230045] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"970810aedaffaa34ebede69e","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-970810aedaffaa34ebede69e: start","job_status":"start","queue_duration_s":0.21139,"scheduling_latency_s":0.211423}1477gitlab # [ 158.245804] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"970810aedaffaa34ebede69e","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-970810aedaffaa34ebede69e: done: 0.016614 sec","job_status":"done","queue_duration_s":0.21139,"scheduling_latency_s":0.211423,"redis_calls":13,"redis_duration_s":0.002914,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016614,"completed_at":"2026-07-06T10:56:31.122Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 158.321134] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7444d2c32a547acd736c1fd6","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7444d2c32a547acd736c1fd6: start","job_status":"start","queue_duration_s":0.229349,"scheduling_latency_s":0.229372}1479gitlab # [ 158.323838] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7444d2c32a547acd736c1fd6","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7444d2c32a547acd736c1fd6: done: 0.015955 sec","job_status":"done","queue_duration_s":0.229349,"scheduling_latency_s":0.229372,"redis_calls":13,"redis_duration_s":0.002995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001022,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015955,"completed_at":"2026-07-06T10:56:31.140Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 158.391821] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ceb7e2783e20dea1c14e63e5","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ceb7e2783e20dea1c14e63e5: start","job_status":"start","queue_duration_s":0.246571,"scheduling_latency_s":0.246592}1481gitlab # [ 158.462448] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ceb7e2783e20dea1c14e63e5","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ceb7e2783e20dea1c14e63e5: done: 0.015718 sec","job_status":"done","queue_duration_s":0.246571,"scheduling_latency_s":0.246592,"redis_calls":13,"redis_duration_s":0.002861,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015718,"completed_at":"2026-07-06T10:56:31.157Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 158.464373] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"814fe136bfe2921ab638aa41","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-814fe136bfe2921ab638aa41: start","job_status":"start","queue_duration_s":0.263609,"scheduling_latency_s":0.263632}1483gitlab # [ 158.531451] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"814fe136bfe2921ab638aa41","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-814fe136bfe2921ab638aa41: done: 0.02569 sec","job_status":"done","queue_duration_s":0.263609,"scheduling_latency_s":0.263632,"redis_calls":13,"redis_duration_s":0.012711,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004121,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00859,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02569,"completed_at":"2026-07-06T10:56:31.184Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 158.538865] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c85f9f046687bbf1e86f3815","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c85f9f046687bbf1e86f3815: start","job_status":"start","queue_duration_s":0.290679,"scheduling_latency_s":0.290702}1485gitlab # [ 158.621392] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c85f9f046687bbf1e86f3815","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c85f9f046687bbf1e86f3815: done: 0.016664 sec","job_status":"done","queue_duration_s":0.290679,"scheduling_latency_s":0.290702,"redis_calls":13,"redis_duration_s":0.0034920000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00109,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002402,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016664,"completed_at":"2026-07-06T10:56:31.202Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 158.623113] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7a6219f12179b18752b61eb","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7a6219f12179b18752b61eb: start","job_status":"start","queue_duration_s":0.308627,"scheduling_latency_s":0.308649}1487gitlab # [ 158.636416] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7a6219f12179b18752b61eb","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7a6219f12179b18752b61eb: done: 0.015649 sec","job_status":"done","queue_duration_s":0.308627,"scheduling_latency_s":0.308649,"redis_calls":13,"redis_duration_s":0.0028510000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015649,"completed_at":"2026-07-06T10:56:31.219Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 158.722964] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0932a76c390c08b8b96dfa05","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0932a76c390c08b8b96dfa05: start","job_status":"start","queue_duration_s":0.325564,"scheduling_latency_s":0.325587}1489gitlab # [ 158.724080] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0932a76c390c08b8b96dfa05","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0932a76c390c08b8b96dfa05: done: 0.015606 sec","job_status":"done","queue_duration_s":0.325564,"scheduling_latency_s":0.325587,"redis_calls":13,"redis_duration_s":0.0028380000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015606,"completed_at":"2026-07-06T10:56:31.236Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 158.798041] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3db00c4b1d3fc70449f810dc","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3db00c4b1d3fc70449f810dc: start","job_status":"start","queue_duration_s":0.342598,"scheduling_latency_s":0.342619}1491gitlab # [ 158.799383] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3db00c4b1d3fc70449f810dc","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3db00c4b1d3fc70449f810dc: done: 0.01656 sec","job_status":"done","queue_duration_s":0.342598,"scheduling_latency_s":0.342619,"redis_calls":13,"redis_duration_s":0.003798,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001399,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002399,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01656,"completed_at":"2026-07-06T10:56:31.254Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 158.883973] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b67e6c3961dbad78d1c63930","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b67e6c3961dbad78d1c63930: start","job_status":"start","queue_duration_s":0.362473,"scheduling_latency_s":0.362497}1493gitlab # [ 158.885293] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b67e6c3961dbad78d1c63930","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b67e6c3961dbad78d1c63930: done: 0.023757 sec","job_status":"done","queue_duration_s":0.362473,"scheduling_latency_s":0.362497,"redis_calls":13,"redis_duration_s":0.010483000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0032,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007283,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023757,"completed_at":"2026-07-06T10:56:31.281Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 158.954410] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcf0aa0e824e329378929a58","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcf0aa0e824e329378929a58: start","job_status":"start","queue_duration_s":0.389592,"scheduling_latency_s":0.389616}1495gitlab # [ 158.955803] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcf0aa0e824e329378929a58","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcf0aa0e824e329378929a58: done: 0.020324 sec","job_status":"done","queue_duration_s":0.389592,"scheduling_latency_s":0.389616,"redis_calls":13,"redis_duration_s":0.007189,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002151,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005038,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020324,"completed_at":"2026-07-06T10:56:31.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 159.023762] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fd967f4a27e3ed7eddcd9e9","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fd967f4a27e3ed7eddcd9e9: start","job_status":"start","queue_duration_s":0.411427,"scheduling_latency_s":0.411451}1497gitlab # [ 159.027873] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fd967f4a27e3ed7eddcd9e9","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fd967f4a27e3ed7eddcd9e9: done: 0.01577 sec","job_status":"done","queue_duration_s":0.411427,"scheduling_latency_s":0.411451,"redis_calls":13,"redis_duration_s":0.003036,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002156,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01577,"completed_at":"2026-07-06T10:56:31.322Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 159.128369] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1c9ee9c21c5954a2d3f557f","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1c9ee9c21c5954a2d3f557f: start","job_status":"start","queue_duration_s":0.428653,"scheduling_latency_s":0.428812}1499gitlab # [ 159.129820] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1c9ee9c21c5954a2d3f557f","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1c9ee9c21c5954a2d3f557f: done: 0.015741 sec","job_status":"done","queue_duration_s":0.428653,"scheduling_latency_s":0.428812,"redis_calls":13,"redis_duration_s":0.0029950000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015741,"completed_at":"2026-07-06T10:56:31.339Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 159.210422] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b56c97ccc6b7ad1ffa5bccd9","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b56c97ccc6b7ad1ffa5bccd9: start","job_status":"start","queue_duration_s":0.445679,"scheduling_latency_s":0.4457}1501gitlab # [ 159.211927] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b56c97ccc6b7ad1ffa5bccd9","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b56c97ccc6b7ad1ffa5bccd9: done: 0.015676 sec","job_status":"done","queue_duration_s":0.445679,"scheduling_latency_s":0.4457,"redis_calls":13,"redis_duration_s":0.0028329999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015676,"completed_at":"2026-07-06T10:56:31.356Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 159.309389] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01c078cbf929504199d0b73a","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01c078cbf929504199d0b73a: start","job_status":"start","queue_duration_s":0.462642,"scheduling_latency_s":0.462662}1503gitlab # [ 159.310853] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.373Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01c078cbf929504199d0b73a","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01c078cbf929504199d0b73a: done: 0.015623 sec","job_status":"done","queue_duration_s":0.462642,"scheduling_latency_s":0.462662,"redis_calls":13,"redis_duration_s":0.002889,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015623,"completed_at":"2026-07-06T10:56:31.373Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 159.388418] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdb50db3c410aa7d1c159454","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdb50db3c410aa7d1c159454: start","job_status":"start","queue_duration_s":0.481259,"scheduling_latency_s":0.481282}1505gitlab # [ 159.389993] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdb50db3c410aa7d1c159454","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdb50db3c410aa7d1c159454: done: 0.018889 sec","job_status":"done","queue_duration_s":0.481259,"scheduling_latency_s":0.481282,"redis_calls":13,"redis_duration_s":0.005468,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003496,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018889,"completed_at":"2026-07-06T10:56:31.395Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 159.402344] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d005e2fdae8804212f57e7fa","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d005e2fdae8804212f57e7fa: start","job_status":"start","queue_duration_s":0.50154,"scheduling_latency_s":0.501564}1507gitlab # [ 159.470597] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d005e2fdae8804212f57e7fa","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d005e2fdae8804212f57e7fa: done: 0.015972 sec","job_status":"done","queue_duration_s":0.50154,"scheduling_latency_s":0.501564,"redis_calls":13,"redis_duration_s":0.00314,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015972,"completed_at":"2026-07-06T10:56:31.412Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 159.480846] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.413Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"744beb13e3bf343a6b6e0d08","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-744beb13e3bf343a6b6e0d08: start","job_status":"start","queue_duration_s":0.518846,"scheduling_latency_s":0.518869}1509gitlab # [ 159.547528] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"744beb13e3bf343a6b6e0d08","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-744beb13e3bf343a6b6e0d08: done: 0.015639 sec","job_status":"done","queue_duration_s":0.518846,"scheduling_latency_s":0.518869,"redis_calls":13,"redis_duration_s":0.002875,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015639,"completed_at":"2026-07-06T10:56:31.429Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 159.558960] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ec548d48c52552455a3095c","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ec548d48c52552455a3095c: start","job_status":"start","queue_duration_s":0.535764,"scheduling_latency_s":0.535784}1511gitlab # [ 159.632432] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.446Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ec548d48c52552455a3095c","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ec548d48c52552455a3095c: done: 0.01576 sec","job_status":"done","queue_duration_s":0.535764,"scheduling_latency_s":0.535784,"redis_calls":13,"redis_duration_s":0.002815,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01576,"completed_at":"2026-07-06T10:56:31.446Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 159.637287] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50089b88db2641b9cf1c451e","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50089b88db2641b9cf1c451e: start","job_status":"start","queue_duration_s":0.552954,"scheduling_latency_s":0.552977}1513gitlab # [ 159.707287] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50089b88db2641b9cf1c451e","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50089b88db2641b9cf1c451e: done: 0.015535 sec","job_status":"done","queue_duration_s":0.552954,"scheduling_latency_s":0.552977,"redis_calls":13,"redis_duration_s":0.002828,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015535,"completed_at":"2026-07-06T10:56:31.463Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 159.715699] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bf457b3c81b81d03338db2e","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bf457b3c81b81d03338db2e: start","job_status":"start","queue_duration_s":0.570111,"scheduling_latency_s":0.570134}1515gitlab # [ 159.782553] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bf457b3c81b81d03338db2e","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bf457b3c81b81d03338db2e: done: 0.015711 sec","job_status":"done","queue_duration_s":0.570111,"scheduling_latency_s":0.570134,"redis_calls":13,"redis_duration_s":0.0030160000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015711,"completed_at":"2026-07-06T10:56:31.480Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 159.794843] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23c44e496705e5f19b659b3c","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23c44e496705e5f19b659b3c: start","job_status":"start","queue_duration_s":0.587301,"scheduling_latency_s":0.587323}1517gitlab # [ 159.814186] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23c44e496705e5f19b659b3c","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23c44e496705e5f19b659b3c: done: 0.015658 sec","job_status":"done","queue_duration_s":0.587301,"scheduling_latency_s":0.587323,"redis_calls":13,"redis_duration_s":0.002901,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015658,"completed_at":"2026-07-06T10:56:31.497Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 159.889362] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f616075421739e1eb7cbd8f","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f616075421739e1eb7cbd8f: start","job_status":"start","queue_duration_s":0.604599,"scheduling_latency_s":0.604621}1519gitlab # [ 159.955906] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f616075421739e1eb7cbd8f","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f616075421739e1eb7cbd8f: done: 0.015671 sec","job_status":"done","queue_duration_s":0.604599,"scheduling_latency_s":0.604621,"redis_calls":13,"redis_duration_s":0.002881,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015671,"completed_at":"2026-07-06T10:56:31.515Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 159.957677] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"822c20f26f539f6bc2ce64a6","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-822c20f26f539f6bc2ce64a6: start","job_status":"start","queue_duration_s":0.621768,"scheduling_latency_s":0.621789}1521gitlab # [ 160.026043] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"822c20f26f539f6bc2ce64a6","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-822c20f26f539f6bc2ce64a6: done: 0.015455 sec","job_status":"done","queue_duration_s":0.621768,"scheduling_latency_s":0.621789,"redis_calls":13,"redis_duration_s":0.0028339999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015455,"completed_at":"2026-07-06T10:56:31.532Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 160.029878] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:31.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cdfe7032a3079b0fa4403df","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cdfe7032a3079b0fa4403df: start","job_status":"start","queue_duration_s":0.638515,"scheduling_latency_s":0.638537}1523gitlab # [ 160.369727] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1851314148 wd_nsec: 18513139861524gitlab # [ 160.131768] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cdfe7032a3079b0fa4403df","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cdfe7032a3079b0fa4403df: done: 2.467476 sec","job_status":"done","queue_duration_s":0.638515,"scheduling_latency_s":0.638537,"redis_calls":13,"redis_duration_s":0.009305,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002252,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":2.467476,"completed_at":"2026-07-06T10:56:34.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 160.193364] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"319ab1b632f1ce4d7eb89135","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-319ab1b632f1ce4d7eb89135: start","job_status":"start","queue_duration_s":3.167887,"scheduling_latency_s":3.16793}1526gitlab # [ 160.233455] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"319ab1b632f1ce4d7eb89135","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-319ab1b632f1ce4d7eb89135: done: 0.04016 sec","job_status":"done","queue_duration_s":3.167887,"scheduling_latency_s":3.16793,"redis_calls":13,"redis_duration_s":0.003262,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.04016,"completed_at":"2026-07-06T10:56:34.102Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 160.268998] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"621b4a077fc10aed48e72167","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-621b4a077fc10aed48e72167: start","job_status":"start","queue_duration_s":3.209792,"scheduling_latency_s":3.209823}1528gitlab # [ 160.270162] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"621b4a077fc10aed48e72167","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-621b4a077fc10aed48e72167: done: 0.018788 sec","job_status":"done","queue_duration_s":3.209792,"scheduling_latency_s":3.209823,"redis_calls":13,"redis_duration_s":0.005345,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001773,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003572,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018788,"completed_at":"2026-07-06T10:56:34.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 160.352564] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"820177b69790122efc117287","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-820177b69790122efc117287: start","job_status":"start","queue_duration_s":3.230518,"scheduling_latency_s":3.23054}1530gitlab # [ 160.406324] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"820177b69790122efc117287","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-820177b69790122efc117287: done: 0.149401 sec","job_status":"done","queue_duration_s":3.230518,"scheduling_latency_s":3.23054,"redis_calls":13,"redis_duration_s":0.127461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002434,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.125027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.149401,"completed_at":"2026-07-06T10:56:34.274Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 160.469231] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10d496b7bba841b27dccc644","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10d496b7bba841b27dccc644: start","job_status":"start","queue_duration_s":3.4424,"scheduling_latency_s":3.442473}1532gitlab # [ 160.512236] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10d496b7bba841b27dccc644","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10d496b7bba841b27dccc644: done: 0.044119 sec","job_status":"done","queue_duration_s":3.4424,"scheduling_latency_s":3.442473,"redis_calls":13,"redis_duration_s":0.008215,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002637,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005578,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.044119,"completed_at":"2026-07-06T10:56:34.381Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 160.574407] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eef1769b8ca7049798bb1585","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eef1769b8ca7049798bb1585: start","job_status":"start","queue_duration_s":3.548435,"scheduling_latency_s":3.548505}1534gitlab # [ 160.616283] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eef1769b8ca7049798bb1585","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eef1769b8ca7049798bb1585: done: 0.042067 sec","job_status":"done","queue_duration_s":3.548435,"scheduling_latency_s":3.548505,"redis_calls":13,"redis_duration_s":0.007934,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005345,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042067,"completed_at":"2026-07-06T10:56:34.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 160.621552] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50ca33672a6e45deffe82272","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50ca33672a6e45deffe82272: start","job_status":"start","queue_duration_s":3.59582,"scheduling_latency_s":3.595872}1536gitlab # [ 160.657294] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50ca33672a6e45deffe82272","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50ca33672a6e45deffe82272: done: 0.035556 sec","job_status":"done","queue_duration_s":3.59582,"scheduling_latency_s":3.595872,"redis_calls":13,"redis_duration_s":0.007597,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002385,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035556,"completed_at":"2026-07-06T10:56:34.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 160.688244] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"091263032aecc72c43a0b80e","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-091263032aecc72c43a0b80e: start","job_status":"start","queue_duration_s":3.637774,"scheduling_latency_s":3.637815}1538gitlab # [ 160.783223] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"091263032aecc72c43a0b80e","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-091263032aecc72c43a0b80e: done: 0.119826 sec","job_status":"done","queue_duration_s":3.637774,"scheduling_latency_s":3.637815,"redis_calls":13,"redis_duration_s":0.100241,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002368,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.097873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.119826,"completed_at":"2026-07-06T10:56:34.652Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 160.844798] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1387a15174638983232d6883","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1387a15174638983232d6883: start","job_status":"start","queue_duration_s":3.818018,"scheduling_latency_s":3.818097}1540gitlab # [ 160.906126] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1387a15174638983232d6883","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1387a15174638983232d6883: done: 0.060774 sec","job_status":"done","queue_duration_s":3.818018,"scheduling_latency_s":3.818097,"redis_calls":13,"redis_duration_s":0.008371,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002605,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005766,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.060774,"completed_at":"2026-07-06T10:56:34.773Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 160.911303] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd9408788339d8ec2a6aea6e","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd9408788339d8ec2a6aea6e: start","job_status":"start","queue_duration_s":3.885522,"scheduling_latency_s":3.885573}1542gitlab # [ 160.944684] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd9408788339d8ec2a6aea6e","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd9408788339d8ec2a6aea6e: done: 0.033767 sec","job_status":"done","queue_duration_s":3.885522,"scheduling_latency_s":3.885573,"redis_calls":13,"redis_duration_s":0.007124,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002176,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033767,"completed_at":"2026-07-06T10:56:34.814Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 161.041584] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e98311f86e87bdaefdd6b637","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e98311f86e87bdaefdd6b637: start","job_status":"start","queue_duration_s":3.925634,"scheduling_latency_s":3.92566}1544gitlab # [ 161.043626] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e98311f86e87bdaefdd6b637","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e98311f86e87bdaefdd6b637: done: 0.024893 sec","job_status":"done","queue_duration_s":3.925634,"scheduling_latency_s":3.92566,"redis_calls":13,"redis_duration_s":0.011324,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007776,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024893,"completed_at":"2026-07-06T10:56:34.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 161.113942] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"573168b42245c4ef2c204e21","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-573168b42245c4ef2c204e21: start","job_status":"start","queue_duration_s":3.952534,"scheduling_latency_s":3.952556}1546gitlab # [ 161.115724] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"573168b42245c4ef2c204e21","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-573168b42245c4ef2c204e21: done: 0.018559 sec","job_status":"done","queue_duration_s":3.952534,"scheduling_latency_s":3.952556,"redis_calls":13,"redis_duration_s":0.005574,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0018,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003774,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018559,"completed_at":"2026-07-06T10:56:34.866Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 161.198234] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be126a142af8d85f05511cbb","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be126a142af8d85f05511cbb: start","job_status":"start","queue_duration_s":3.972974,"scheduling_latency_s":3.972995}1548gitlab # [ 161.199514] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be126a142af8d85f05511cbb","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be126a142af8d85f05511cbb: done: 0.018418 sec","job_status":"done","queue_duration_s":3.972974,"scheduling_latency_s":3.972995,"redis_calls":13,"redis_duration_s":0.0057410000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018418,"completed_at":"2026-07-06T10:56:34.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 161.272983] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53182ce8d4bf0fa4dd7ef4ab","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53182ce8d4bf0fa4dd7ef4ab: start","job_status":"start","queue_duration_s":3.993559,"scheduling_latency_s":3.993581}1550gitlab # [ 161.274358] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.907Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53182ce8d4bf0fa4dd7ef4ab","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53182ce8d4bf0fa4dd7ef4ab: done: 0.018441 sec","job_status":"done","queue_duration_s":3.993559,"scheduling_latency_s":3.993581,"redis_calls":13,"redis_duration_s":0.005676,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003783,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018441,"completed_at":"2026-07-06T10:56:34.906Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 161.354406] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebed363079f24f42641bf3aa","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebed363079f24f42641bf3aa: start","job_status":"start","queue_duration_s":4.014005,"scheduling_latency_s":4.014028}1552gitlab # [ 161.355895] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebed363079f24f42641bf3aa","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebed363079f24f42641bf3aa: done: 0.020701 sec","job_status":"done","queue_duration_s":4.014005,"scheduling_latency_s":4.014028,"redis_calls":13,"redis_duration_s":0.005350000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003419,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020701,"completed_at":"2026-07-06T10:56:34.929Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 161.372210] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c450dbe0a962d32fdc97d88d","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c450dbe0a962d32fdc97d88d: start","job_status":"start","queue_duration_s":4.036411,"scheduling_latency_s":4.036433}1554gitlab # [ 161.453266] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c450dbe0a962d32fdc97d88d","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c450dbe0a962d32fdc97d88d: done: 0.017393 sec","job_status":"done","queue_duration_s":4.036411,"scheduling_latency_s":4.036433,"redis_calls":13,"redis_duration_s":0.004882,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001766,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017393,"completed_at":"2026-07-06T10:56:34.948Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 161.455235] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9528fa10e0bb484285f027c5","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9528fa10e0bb484285f027c5: start","job_status":"start","queue_duration_s":4.055485,"scheduling_latency_s":4.055506}1556gitlab # [ 161.523719] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9528fa10e0bb484285f027c5","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9528fa10e0bb484285f027c5: done: 0.016931 sec","job_status":"done","queue_duration_s":4.055485,"scheduling_latency_s":4.055506,"redis_calls":13,"redis_duration_s":0.004368,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001387,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016931,"completed_at":"2026-07-06T10:56:34.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 161.529139] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b24a0274cad015e87ce2b2a4","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b24a0274cad015e87ce2b2a4: start","job_status":"start","queue_duration_s":4.074497,"scheduling_latency_s":4.074518}1558gitlab # [ 161.550147] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b24a0274cad015e87ce2b2a4","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b24a0274cad015e87ce2b2a4: done: 0.019641 sec","job_status":"done","queue_duration_s":4.074497,"scheduling_latency_s":4.074518,"redis_calls":13,"redis_duration_s":0.007084,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0037,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003384,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019641,"completed_at":"2026-07-06T10:56:34.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 161.632723] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:34.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2511eeb01ec86589df6ae6de","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2511eeb01ec86589df6ae6de: start","job_status":"start","queue_duration_s":4.097702,"scheduling_latency_s":4.097725}1560gitlab # [ 161.634307] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:35.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2511eeb01ec86589df6ae6de","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2511eeb01ec86589df6ae6de: done: 0.019188 sec","job_status":"done","queue_duration_s":4.097702,"scheduling_latency_s":4.097725,"redis_calls":13,"redis_duration_s":0.00602,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002612,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003408,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019188,"completed_at":"2026-07-06T10:56:35.011Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 161.741252] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:35.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"593bc9852af395857a403419","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-593bc9852af395857a403419: start","job_status":"start","queue_duration_s":4.118375,"scheduling_latency_s":4.118397}1562gitlab # [ 161.742865] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:35.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"593bc9852af395857a403419","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-593bc9852af395857a403419: done: 0.016243 sec","job_status":"done","queue_duration_s":4.118375,"scheduling_latency_s":4.118397,"redis_calls":13,"redis_duration_s":0.003786,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016243,"completed_at":"2026-07-06T10:56:35.029Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 161.811352] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:35.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"395bde7ce004572d84122c2a","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-395bde7ce004572d84122c2a: start","job_status":"start","queue_duration_s":4.135922,"scheduling_latency_s":4.135952}1564gitlab # [ 161.812874] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:56:35.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"395bde7ce004572d84122c2a","created_at":"2026-07-06T10:56:30.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-6914ebdea931490b","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"19880ff96c39319723829748a911c9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:56:30.895Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-395bde7ce004572d84122c2a: done: 0.015571 sec","job_status":"done","queue_duration_s":4.135922,"scheduling_latency_s":4.135952,"redis_calls":13,"redis_duration_s":0.002815,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015571,"completed_at":"2026-07-06T10:56:35.046Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 174.614475] setup-gitlab-start[2749]: W, [2026-07-06T10:56:48.483324 #2749] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1566gitlab # [ 191.023169] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:04.890Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"71a47b08f61ab58fd67b5c4b","created_at":"2026-07-06T10:57:04.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a9f64a83df0e72bcf820c44e77f97ef","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:04.887Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-71a47b08f61ab58fd67b5c4b: start","job_status":"start","queue_duration_s":0.003136,"scheduling_latency_s":0.003204}1567gitlab # [ 191.266109] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.134Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"71a47b08f61ab58fd67b5c4b","created_at":"2026-07-06T10:57:04.822Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a9f64a83df0e72bcf820c44e77f97ef","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:04.887Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-71a47b08f61ab58fd67b5c4b: done: 0.244374 sec","job_status":"done","queue_duration_s":0.003136,"scheduling_latency_s":0.003204,"redis_calls":10,"redis_duration_s":0.045239,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010918,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.034321,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.077,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.077,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.082071604,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.244374,"completed_at":"2026-07-06T10:57:05.134Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.092926,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1568gitlab # [ 191.368233] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.237Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8bbc994fee805850c57f3de8","created_at":"2026-07-06T10:57:04.962Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50b8519f9bb872d82369b722c951eddc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:04.968Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8bbc994fee805850c57f3de8: start","job_status":"start","queue_duration_s":0.268339,"scheduling_latency_s":0.268514}1569gitlab # [ 191.455720] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.324Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8bbc994fee805850c57f3de8","created_at":"2026-07-06T10:57:04.962Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50b8519f9bb872d82369b722c951eddc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:04.968Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8bbc994fee805850c57f3de8: done: 0.087929 sec","job_status":"done","queue_duration_s":0.268339,"scheduling_latency_s":0.268514,"redis_calls":7,"redis_duration_s":0.008925,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004465,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00446,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.087929,"completed_at":"2026-07-06T10:57:05.324Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024337,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1570gitlab # [ 191.542808] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.411Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b8d09cb567b1de766bdd3562","created_at":"2026-07-06T10:57:05.027Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9c5fc8107ce9951b874707881ade95f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.032Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b8d09cb567b1de766bdd3562: start","job_status":"start","queue_duration_s":0.37823,"scheduling_latency_s":0.378373}1571gitlab # [ 191.596366] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.465Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1572gitlab # [ 191.620842] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.490Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b8d09cb567b1de766bdd3562","created_at":"2026-07-06T10:57:05.027Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9c5fc8107ce9951b874707881ade95f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.032Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b8d09cb567b1de766bdd3562: done: 0.078876 sec","job_status":"done","queue_duration_s":0.37823,"scheduling_latency_s":0.378373,"redis_calls":7,"redis_duration_s":0.021778,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.016666,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005112,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.078876,"completed_at":"2026-07-06T10:57:05.489Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 191.691789] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b7c8422f165ee2bbb3c131fe","created_at":"2026-07-06T10:57:05.055Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88790baf0da7b522cd21b1d5d9dd8078","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.057Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b7c8422f165ee2bbb3c131fe: start","job_status":"start","queue_duration_s":0.503301,"scheduling_latency_s":0.503373}1574gitlab # [ 191.821944] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.691Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b7c8422f165ee2bbb3c131fe","created_at":"2026-07-06T10:57:05.055Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88790baf0da7b522cd21b1d5d9dd8078","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.057Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b7c8422f165ee2bbb3c131fe: done: 0.130547 sec","job_status":"done","queue_duration_s":0.503301,"scheduling_latency_s":0.503373,"redis_calls":9,"redis_duration_s":0.00722,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003346,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003874,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.061,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001798553,"exclusive_lock_hold_duration_s":0.055459562,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.130547,"completed_at":"2026-07-06T10:57:05.691Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0691,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 191.909201] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.703Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0d19307851c15ed146ae9873","created_at":"2026-07-06T10:57:05.061Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08de240b7a324c066a35668bca9081d2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-06T10:57:05.063Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0d19307851c15ed146ae9873: start","job_status":"start","queue_duration_s":0.639879,"scheduling_latency_s":0.639912}1576gitlab # [ 191.930132] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.734Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1577gitlab # [ 191.935604] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.743Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0d19307851c15ed146ae9873","created_at":"2026-07-06T10:57:05.061Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08de240b7a324c066a35668bca9081d2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-06T10:57:05.063Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0d19307851c15ed146ae9873: done: 0.040116 sec","job_status":"done","queue_duration_s":0.639879,"scheduling_latency_s":0.639912,"redis_calls":7,"redis_duration_s":0.0032779999999999997,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002508,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00077,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040116,"completed_at":"2026-07-06T10:57:05.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1578gitlab # [ 191.997660] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"86c8ebfdab9ecedb64ca0556","created_at":"2026-07-06T10:57:05.067Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c959127ca7f6741822f7e36730279fcf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.069Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-86c8ebfdab9ecedb64ca0556: start","job_status":"start","queue_duration_s":0.675286,"scheduling_latency_s":0.675317}1579gitlab # [ 191.998979] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.753Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1580gitlab # [ 192.002297] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.759Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"86c8ebfdab9ecedb64ca0556","created_at":"2026-07-06T10:57:05.067Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c959127ca7f6741822f7e36730279fcf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.069Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-86c8ebfdab9ecedb64ca0556: done: 0.014245 sec","job_status":"done","queue_duration_s":0.675286,"scheduling_latency_s":0.675317,"redis_calls":7,"redis_duration_s":0.003303,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002381,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014245,"completed_at":"2026-07-06T10:57:05.759Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581gitlab # [ 192.080287] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.761Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9edbe8c38ae1d6cbed885003","created_at":"2026-07-06T10:57:05.074Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d425b4583e5fe4afbeccb4b90132a055","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.077Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9edbe8c38ae1d6cbed885003: start","job_status":"start","queue_duration_s":0.684016,"scheduling_latency_s":0.684083}1582gitlab # [ 192.081567] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.781Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9edbe8c38ae1d6cbed885003","created_at":"2026-07-06T10:57:05.074Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d425b4583e5fe4afbeccb4b90132a055","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.077Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9edbe8c38ae1d6cbed885003: done: 0.020501 sec","job_status":"done","queue_duration_s":0.684016,"scheduling_latency_s":0.684083,"redis_calls":9,"redis_duration_s":0.004233000000000001,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002256,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001977,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000845359,"exclusive_lock_hold_duration_s":0.004679365,"duration_s":0.020501,"completed_at":"2026-07-06T10:57:05.781Z","load_balancing_strategy":"primary","db_duration_s":0.002654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 192.103456] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.783Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"a912810b0b0aff02dc2885fc","created_at":"2026-07-06T10:57:05.080Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fed41b9c14a858a61091d507961dfbd5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.082Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-a912810b0b0aff02dc2885fc: start","job_status":"start","queue_duration_s":0.701411,"scheduling_latency_s":0.701431}1584gitlab # [ 192.193161] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.792Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1585gitlab # [ 192.196153] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.797Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"a912810b0b0aff02dc2885fc","created_at":"2026-07-06T10:57:05.080Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fed41b9c14a858a61091d507961dfbd5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.082Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-a912810b0b0aff02dc2885fc: done: 0.01391 sec","job_status":"done","queue_duration_s":0.701411,"scheduling_latency_s":0.701431,"redis_calls":7,"redis_duration_s":0.002948,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002153,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000795,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01391,"completed_at":"2026-07-06T10:57:05.797Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1586gitlab # [ 192.198221] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.800Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"7b68c450803972df97729ba2","created_at":"2026-07-06T10:57:05.103Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df1b5ca3136490791fe4375e4774cce4","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.107Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-7b68c450803972df97729ba2: start","job_status":"start","queue_duration_s":0.692513,"scheduling_latency_s":0.692536}1587gitlab # [ 192.217638] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.816Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"7b68c450803972df97729ba2","created_at":"2026-07-06T10:57:05.103Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df1b5ca3136490791fe4375e4774cce4","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.107Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-7b68c450803972df97729ba2: done: 0.01619 sec","job_status":"done","queue_duration_s":0.692513,"scheduling_latency_s":0.692536,"redis_calls":7,"redis_duration_s":0.0033450000000000003,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002279,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01619,"completed_at":"2026-07-06T10:57:05.816Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001496,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1588gitlab # [ 192.293830] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.818Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"82d86e5d07974d73d82888f7","created_at":"2026-07-06T10:57:05.122Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b834b1ab366ddc1a4c94f881180482d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.125Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-82d86e5d07974d73d82888f7: start","job_status":"start","queue_duration_s":0.692688,"scheduling_latency_s":0.69271}1589gitlab # [ 192.301173] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"82d86e5d07974d73d82888f7","created_at":"2026-07-06T10:57:05.122Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b834b1ab366ddc1a4c94f881180482d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.125Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-82d86e5d07974d73d82888f7: done: 0.018374 sec","job_status":"done","queue_duration_s":0.692688,"scheduling_latency_s":0.69271,"redis_calls":9,"redis_duration_s":0.004096,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002193,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001903,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000710705,"exclusive_lock_hold_duration_s":0.003519163,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.018374,"completed_at":"2026-07-06T10:57:05.836Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002321,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1590gitlab # [ 192.394520] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.839Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e9d9a6004fa83c5a79e8ccda","created_at":"2026-07-06T10:57:05.232Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94d512b9327f456a8c86715b6b2ef6e1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.239Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e9d9a6004fa83c5a79e8ccda: start","job_status":"start","queue_duration_s":0.599058,"scheduling_latency_s":0.599079}1591gitlab # [ 192.396281] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.847Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1592gitlab # [ 192.397203] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.852Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e9d9a6004fa83c5a79e8ccda","created_at":"2026-07-06T10:57:05.232Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94d512b9327f456a8c86715b6b2ef6e1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.239Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e9d9a6004fa83c5a79e8ccda: done: 0.013932 sec","job_status":"done","queue_duration_s":0.599058,"scheduling_latency_s":0.599079,"redis_calls":7,"redis_duration_s":0.003312,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002395,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013932,"completed_at":"2026-07-06T10:57:05.852Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 192.466354] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:05.854Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"6c4a26ea1a6c1b1ff979f886","created_at":"2026-07-06T10:57:05.290Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53e16ec570324021c09aaee05a2357ef","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.296Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-6c4a26ea1a6c1b1ff979f886: start","job_status":"start","queue_duration_s":0.557859,"scheduling_latency_s":0.557881}1594gitlab # [ 192.478044] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.272Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"6c4a26ea1a6c1b1ff979f886","created_at":"2026-07-06T10:57:05.290Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53e16ec570324021c09aaee05a2357ef","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.296Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-6c4a26ea1a6c1b1ff979f886: done: 0.417935 sec","job_status":"done","queue_duration_s":0.557859,"scheduling_latency_s":0.557881,"redis_calls":571,"redis_duration_s":0.13733499999999998,"redis_read_bytes":569,"redis_write_bytes":49487,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002217,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.135118,"redis_shared_state_read_bytes":565,"redis_shared_state_write_bytes":49017,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.311709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.417935,"completed_at":"2026-07-06T10:57:06.272Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595gitlab # [ 192.581293] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.274Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"88b2c3e176259c186f63d1ef","created_at":"2026-07-06T10:57:05.310Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8769951b7361b3a76971aceedb9e2799","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.316Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-88b2c3e176259c186f63d1ef: start","job_status":"start","queue_duration_s":0.957888,"scheduling_latency_s":0.957921}1596gitlab # [ 192.582785] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.316Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"88b2c3e176259c186f63d1ef","created_at":"2026-07-06T10:57:05.310Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8769951b7361b3a76971aceedb9e2799","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.316Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-88b2c3e176259c186f63d1ef: done: 0.041988 sec","job_status":"done","queue_duration_s":0.957888,"scheduling_latency_s":0.957921,"redis_calls":9,"redis_duration_s":0.002272,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001231,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001041,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000472127,"exclusive_lock_hold_duration_s":0.027695978,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.041988,"completed_at":"2026-07-06T10:57:06.316Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020544,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 192.690114] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.318Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"497b1367ba617ac52231fd12","created_at":"2026-07-06T10:57:05.407Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"885d13c14467701c6b1e912fd4d5912a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.416Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-497b1367ba617ac52231fd12: start","job_status":"start","queue_duration_s":0.901205,"scheduling_latency_s":0.901227}1598gitlab # [ 192.691405] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.481Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"497b1367ba617ac52231fd12","created_at":"2026-07-06T10:57:05.407Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"885d13c14467701c6b1e912fd4d5912a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.416Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-497b1367ba617ac52231fd12: done: 0.163491 sec","job_status":"done","queue_duration_s":0.901205,"scheduling_latency_s":0.901227,"redis_calls":9,"redis_duration_s":0.002385,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001224,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001161,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":123,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":123,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":123,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":80,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.031,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.120435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000495873,"exclusive_lock_hold_duration_s":0.148735943,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.163491,"completed_at":"2026-07-06T10:57:06.481Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050952,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 192.763378] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.483Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e21f256e8b619ee16634ff59","created_at":"2026-07-06T10:57:05.467Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1bd112da5ebac7e1b0119913707d9c61","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-06T10:57:05.479Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e21f256e8b619ee16634ff59: start","job_status":"start","queue_duration_s":1.003489,"scheduling_latency_s":1.003513}1600gitlab # [ 192.764604] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.502Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e21f256e8b619ee16634ff59","created_at":"2026-07-06T10:57:05.467Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1bd112da5ebac7e1b0119913707d9c61","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-06T10:57:05.479Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e21f256e8b619ee16634ff59: done: 0.019694 sec","job_status":"done","queue_duration_s":1.003489,"scheduling_latency_s":1.003513,"redis_calls":8,"redis_duration_s":0.0019529999999999999,"redis_read_bytes":133,"redis_write_bytes":811,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000222,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001243,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000488,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019694,"completed_at":"2026-07-06T10:57:06.502Z","load_balancing_strategy":"primary","db_duration_s":0.001393,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601gitlab # [ 192.837998] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.504Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b5b2ccc84028473449aa180d","created_at":"2026-07-06T10:57:05.554Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e803a8d48b6bf9a25f18fa44210326c0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.559Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b5b2ccc84028473449aa180d: start","job_status":"start","queue_duration_s":0.944496,"scheduling_latency_s":0.944518}1602gitlab # [ 192.839519] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.516Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b5b2ccc84028473449aa180d","created_at":"2026-07-06T10:57:05.554Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e803a8d48b6bf9a25f18fa44210326c0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.559Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b5b2ccc84028473449aa180d: done: 0.012195 sec","job_status":"done","queue_duration_s":0.944496,"scheduling_latency_s":0.944518,"redis_calls":7,"redis_duration_s":0.001581,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012195,"completed_at":"2026-07-06T10:57:06.516Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 192.910916] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.518Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c561128654c26bc69ea24ff3","created_at":"2026-07-06T10:57:05.606Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d92a7fdea59f064b5297919e162d24f5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.614Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c561128654c26bc69ea24ff3: start","job_status":"start","queue_duration_s":0.903171,"scheduling_latency_s":0.903193}1604gitlab # [ 192.912616] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c561128654c26bc69ea24ff3","created_at":"2026-07-06T10:57:05.606Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d92a7fdea59f064b5297919e162d24f5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.614Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c561128654c26bc69ea24ff3: done: 0.016536 sec","job_status":"done","queue_duration_s":0.903171,"scheduling_latency_s":0.903193,"redis_calls":7,"redis_duration_s":0.001607,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001174,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000433,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.016536,"completed_at":"2026-07-06T10:57:06.534Z","load_balancing_strategy":"primary","db_duration_s":0.004163,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605gitlab # [ 192.996040] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"259bf05ce29e9824ed285586","created_at":"2026-07-06T10:57:05.649Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c31a964d054aa26fe63b5c6f98bb9f23","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.656Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-259bf05ce29e9824ed285586: start","job_status":"start","queue_duration_s":0.879659,"scheduling_latency_s":0.879683}1606gitlab # [ 192.997498] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.556Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"259bf05ce29e9824ed285586","created_at":"2026-07-06T10:57:05.649Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c31a964d054aa26fe63b5c6f98bb9f23","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.656Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-259bf05ce29e9824ed285586: done: 0.020363 sec","job_status":"done","queue_duration_s":0.879659,"scheduling_latency_s":0.879683,"redis_calls":14,"redis_duration_s":0.0033179999999999998,"redis_read_bytes":15,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000342,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.00224,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000736,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020363,"completed_at":"2026-07-06T10:57:06.556Z","load_balancing_strategy":"primary","db_duration_s":0.000879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607gitlab # [ 193.082733] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.557Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f3342a370edd02c6e44a77ef","created_at":"2026-07-06T10:57:05.672Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c1493075f705d61e50b89f21eabc5328","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-06T10:57:05.675Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f3342a370edd02c6e44a77ef: start","job_status":"start","queue_duration_s":0.881702,"scheduling_latency_s":0.881724}1608gitlab # [ 193.084094] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.565Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1609gitlab # [ 193.085047] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.572Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f3342a370edd02c6e44a77ef","created_at":"2026-07-06T10:57:05.672Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c1493075f705d61e50b89f21eabc5328","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-06T10:57:05.675Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f3342a370edd02c6e44a77ef: done: 0.015082 sec","job_status":"done","queue_duration_s":0.881702,"scheduling_latency_s":0.881724,"redis_calls":7,"redis_duration_s":0.00212,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001509,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000611,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015082,"completed_at":"2026-07-06T10:57:06.572Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1610gitlab # [ 193.161103] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.574Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c52715a3566a44a5da5ca8ce","created_at":"2026-07-06T10:57:05.692Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f638741eb7bb630f7f044261cf85f3b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.699Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c52715a3566a44a5da5ca8ce: start","job_status":"start","queue_duration_s":0.874947,"scheduling_latency_s":0.874978}1611gitlab # [ 193.163305] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.588Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c52715a3566a44a5da5ca8ce","created_at":"2026-07-06T10:57:05.692Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f638741eb7bb630f7f044261cf85f3b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.699Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c52715a3566a44a5da5ca8ce: done: 0.013894 sec","job_status":"done","queue_duration_s":0.874947,"scheduling_latency_s":0.874978,"redis_calls":7,"redis_duration_s":0.001595,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001168,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000427,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013894,"completed_at":"2026-07-06T10:57:06.588Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1612gitlab # [ 193.237216] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.589Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"654b4249278659a0aee85d69","created_at":"2026-07-06T10:57:05.711Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.715Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-654b4249278659a0aee85d69: start","job_status":"start","queue_duration_s":0.874472,"scheduling_latency_s":0.874492}1613gitlab # [ 193.246515] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.674Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"654b4249278659a0aee85d69","created_at":"2026-07-06T10:57:05.711Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-987e33d36c144fc6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:05.715Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-654b4249278659a0aee85d69: done: 0.08515 sec","job_status":"done","queue_duration_s":0.874472,"scheduling_latency_s":0.874492,"redis_calls":60,"redis_duration_s":0.018837,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.000992,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.017186,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000659,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.08515,"completed_at":"2026-07-06T10:57:06.674Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1614gitlab # [ 193.323260] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.676Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"792323d925d75e82d22df315","created_at":"2026-07-06T10:57:06.545Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-19ee74e2525444e6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c31a964d054aa26fe63b5c6f98bb9f23","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.551Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-792323d925d75e82d22df315: start","job_status":"start","queue_duration_s":0.124564,"scheduling_latency_s":0.124593}1615gitlab # [ 193.328829] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.687Z","message":"No existing merge request to be cleaned up."}1616gitlab # [ 193.331199] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.694Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"792323d925d75e82d22df315","created_at":"2026-07-06T10:57:06.545Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-19ee74e2525444e6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c31a964d054aa26fe63b5c6f98bb9f23","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.551Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-792323d925d75e82d22df315: done: 0.017958 sec","job_status":"done","queue_duration_s":0.124564,"scheduling_latency_s":0.124593,"redis_calls":10,"redis_duration_s":0.002421,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001493,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017958,"completed_at":"2026-07-06T10:57:06.694Z","load_balancing_strategy":"primary","db_duration_s":0.002038,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 193.406846] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.695Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c36516c321e1f41c0d60cede","created_at":"2026-07-06T10:57:06.545Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-19ee74e2525444e6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c31a964d054aa26fe63b5c6f98bb9f23","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.551Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c36516c321e1f41c0d60cede: start","job_status":"start","queue_duration_s":0.143785,"scheduling_latency_s":0.143807}1618gitlab # [ 193.409254] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.704Z","message":"No existing merge request to be cleaned up."}1619gitlab # [ 193.412247] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.712Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c36516c321e1f41c0d60cede","created_at":"2026-07-06T10:57:06.545Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-19ee74e2525444e6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c31a964d054aa26fe63b5c6f98bb9f23","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.551Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c36516c321e1f41c0d60cede: done: 0.017423 sec","job_status":"done","queue_duration_s":0.143785,"scheduling_latency_s":0.143807,"redis_calls":10,"redis_duration_s":0.004357,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001985,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002372,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017423,"completed_at":"2026-07-06T10:57:06.712Z","load_balancing_strategy":"primary","db_duration_s":0.001378,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1620gitlab # [ 193.494279] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.714Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"88accbd09272e596e08bb98f","created_at":"2026-07-06T10:57:06.545Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-19ee74e2525444e6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c31a964d054aa26fe63b5c6f98bb9f23","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.551Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-88accbd09272e596e08bb98f: start","job_status":"start","queue_duration_s":0.162879,"scheduling_latency_s":0.162901}1621gitlab # [ 193.495739] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.724Z","message":"No existing merge request to be cleaned up."}1622gitlab # [ 193.496911] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.730Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"88accbd09272e596e08bb98f","created_at":"2026-07-06T10:57:06.545Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-19ee74e2525444e6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c31a964d054aa26fe63b5c6f98bb9f23","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.551Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-88accbd09272e596e08bb98f: done: 0.015547 sec","job_status":"done","queue_duration_s":0.162879,"scheduling_latency_s":0.162901,"redis_calls":10,"redis_duration_s":0.002451,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001119,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001332,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015547,"completed_at":"2026-07-06T10:57:06.730Z","load_balancing_strategy":"primary","db_duration_s":0.001486,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 193.571435] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.731Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"25b87625ea3c5795922cd5c7","created_at":"2026-07-06T10:57:06.545Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-19ee74e2525444e6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c31a964d054aa26fe63b5c6f98bb9f23","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.551Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-25b87625ea3c5795922cd5c7: start","job_status":"start","queue_duration_s":0.179713,"scheduling_latency_s":0.179735}1624gitlab # [ 193.572867] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.740Z","message":"No existing merge request to be cleaned up."}1625gitlab # [ 193.574147] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.746Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"25b87625ea3c5795922cd5c7","created_at":"2026-07-06T10:57:06.545Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-19ee74e2525444e6","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c31a964d054aa26fe63b5c6f98bb9f23","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.551Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-25b87625ea3c5795922cd5c7: done: 0.015355 sec","job_status":"done","queue_duration_s":0.179713,"scheduling_latency_s":0.179735,"redis_calls":10,"redis_duration_s":0.002232,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001334,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015355,"completed_at":"2026-07-06T10:57:06.746Z","load_balancing_strategy":"primary","db_duration_s":0.001395,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1626gitlab # [ 193.643193] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a299ccb3ac52d91d6b4323a9","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a299ccb3ac52d91d6b4323a9: start","job_status":"start","queue_duration_s":0.080714,"scheduling_latency_s":0.080735}1627gitlab # [ 193.715681] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a299ccb3ac52d91d6b4323a9","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a299ccb3ac52d91d6b4323a9: done: 0.015291 sec","job_status":"done","queue_duration_s":0.080714,"scheduling_latency_s":0.080735,"redis_calls":13,"redis_duration_s":0.002791,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015291,"completed_at":"2026-07-06T10:57:06.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1628gitlab # [ 193.718053] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcf8951e9474ab13633fd83c","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcf8951e9474ab13633fd83c: start","job_status":"start","queue_duration_s":0.097302,"scheduling_latency_s":0.097324}1629gitlab # [ 193.731776] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcf8951e9474ab13633fd83c","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcf8951e9474ab13633fd83c: done: 0.015069 sec","job_status":"done","queue_duration_s":0.097302,"scheduling_latency_s":0.097324,"redis_calls":13,"redis_duration_s":0.002928,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001023,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015069,"completed_at":"2026-07-06T10:57:06.779Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1630gitlab # [ 193.822245] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd9c9f0d6a145d0d747d4ab1","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd9c9f0d6a145d0d747d4ab1: start","job_status":"start","queue_duration_s":0.115312,"scheduling_latency_s":0.115335}1631gitlab # [ 193.823747] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd9c9f0d6a145d0d747d4ab1","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd9c9f0d6a145d0d747d4ab1: done: 0.02178 sec","job_status":"done","queue_duration_s":0.115312,"scheduling_latency_s":0.115335,"redis_calls":13,"redis_duration_s":0.008202,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002133,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02178,"completed_at":"2026-07-06T10:57:06.804Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1632gitlab # [ 193.892283] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.806Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce1ab56f99a0780ee328bca1","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce1ab56f99a0780ee328bca1: start","job_status":"start","queue_duration_s":0.13883,"scheduling_latency_s":0.138852}1633gitlab # [ 193.893812] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce1ab56f99a0780ee328bca1","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce1ab56f99a0780ee328bca1: done: 0.015238 sec","job_status":"done","queue_duration_s":0.13883,"scheduling_latency_s":0.138852,"redis_calls":13,"redis_duration_s":0.002915,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015238,"completed_at":"2026-07-06T10:57:06.821Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1634gitlab # [ 193.977942] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8b15dec8c9cd001465cc0b9","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8b15dec8c9cd001465cc0b9: start","job_status":"start","queue_duration_s":0.155335,"scheduling_latency_s":0.155356}1635gitlab # [ 193.979356] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8b15dec8c9cd001465cc0b9","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8b15dec8c9cd001465cc0b9: done: 0.015091 sec","job_status":"done","queue_duration_s":0.155335,"scheduling_latency_s":0.155356,"redis_calls":13,"redis_duration_s":0.002835,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015091,"completed_at":"2026-07-06T10:57:06.837Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1636gitlab # [ 194.047172] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86b50eb96804b747b7b3cada","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86b50eb96804b747b7b3cada: start","job_status":"start","queue_duration_s":0.179827,"scheduling_latency_s":0.17985}1637gitlab # [ 194.048396] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86b50eb96804b747b7b3cada","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86b50eb96804b747b7b3cada: done: 0.015274 sec","job_status":"done","queue_duration_s":0.179827,"scheduling_latency_s":0.17985,"redis_calls":13,"redis_duration_s":0.003022,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00211,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015274,"completed_at":"2026-07-06T10:57:06.862Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1638gitlab # [ 194.149621] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d8496e9d9832f78ed3c090b","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d8496e9d9832f78ed3c090b: start","job_status":"start","queue_duration_s":0.196369,"scheduling_latency_s":0.196391}1639gitlab # [ 194.150974] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d8496e9d9832f78ed3c090b","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d8496e9d9832f78ed3c090b: done: 0.024544 sec","job_status":"done","queue_duration_s":0.196369,"scheduling_latency_s":0.196391,"redis_calls":13,"redis_duration_s":0.010143,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007594,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024544,"completed_at":"2026-07-06T10:57:06.888Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1640gitlab # [ 194.225186] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"851cadd45d1f35c0ca7bfac8","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-851cadd45d1f35c0ca7bfac8: start","job_status":"start","queue_duration_s":0.222252,"scheduling_latency_s":0.222274}1641gitlab # [ 194.226451] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"851cadd45d1f35c0ca7bfac8","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-851cadd45d1f35c0ca7bfac8: done: 0.015145 sec","job_status":"done","queue_duration_s":0.222252,"scheduling_latency_s":0.222274,"redis_calls":13,"redis_duration_s":0.002888,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015145,"completed_at":"2026-07-06T10:57:06.904Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1642gitlab # [ 194.307245] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1330e6d049f9301b295a22c","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1330e6d049f9301b295a22c: start","job_status":"start","queue_duration_s":0.238716,"scheduling_latency_s":0.238736}1643gitlab # [ 194.308839] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1330e6d049f9301b295a22c","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1330e6d049f9301b295a22c: done: 0.015061 sec","job_status":"done","queue_duration_s":0.238716,"scheduling_latency_s":0.238736,"redis_calls":13,"redis_duration_s":0.002977,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015061,"completed_at":"2026-07-06T10:57:06.921Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1644gitlab # [ 194.335073] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c1e07914f5667db870b9479","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c1e07914f5667db870b9479: start","job_status":"start","queue_duration_s":0.255027,"scheduling_latency_s":0.255048}1645gitlab # [ 194.414200] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c1e07914f5667db870b9479","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c1e07914f5667db870b9479: done: 0.014775 sec","job_status":"done","queue_duration_s":0.255027,"scheduling_latency_s":0.255048,"redis_calls":13,"redis_duration_s":0.002885,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014775,"completed_at":"2026-07-06T10:57:06.937Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1646gitlab # [ 194.416170] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5265b03d71097ca2ce2efe54","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5265b03d71097ca2ce2efe54: start","job_status":"start","queue_duration_s":0.271156,"scheduling_latency_s":0.271177}1647gitlab # [ 194.487203] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5265b03d71097ca2ce2efe54","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5265b03d71097ca2ce2efe54: done: 0.014951 sec","job_status":"done","queue_duration_s":0.271156,"scheduling_latency_s":0.271177,"redis_calls":13,"redis_duration_s":0.0030940000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000995,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014951,"completed_at":"2026-07-06T10:57:06.953Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1648gitlab # [ 194.489169] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"376d1a00b5e10e8b11c02876","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-376d1a00b5e10e8b11c02876: start","job_status":"start","queue_duration_s":0.287435,"scheduling_latency_s":0.287457}1649gitlab # [ 194.557257] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"376d1a00b5e10e8b11c02876","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-376d1a00b5e10e8b11c02876: done: 0.015106 sec","job_status":"done","queue_duration_s":0.287435,"scheduling_latency_s":0.287457,"redis_calls":13,"redis_duration_s":0.003088,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015106,"completed_at":"2026-07-06T10:57:06.969Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1650gitlab # [ 194.626218] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac3b42eab62b974f29352e23","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac3b42eab62b974f29352e23: start","job_status":"start","queue_duration_s":0.303892,"scheduling_latency_s":0.303913}1651gitlab # [ 194.627786] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac3b42eab62b974f29352e23","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac3b42eab62b974f29352e23: done: 0.015031 sec","job_status":"done","queue_duration_s":0.303892,"scheduling_latency_s":0.303913,"redis_calls":13,"redis_duration_s":0.0030080000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000887,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015031,"completed_at":"2026-07-06T10:57:06.986Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1652gitlab # [ 194.641799] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:06.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8eec4a494b0b23c53d40ab40","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8eec4a494b0b23c53d40ab40: start","job_status":"start","queue_duration_s":0.320223,"scheduling_latency_s":0.320245}1653gitlab # [ 194.717166] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8eec4a494b0b23c53d40ab40","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8eec4a494b0b23c53d40ab40: done: 0.015016 sec","job_status":"done","queue_duration_s":0.320223,"scheduling_latency_s":0.320245,"redis_calls":13,"redis_duration_s":0.003052,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002142,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015016,"completed_at":"2026-07-06T10:57:07.002Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654gitlab # [ 194.719158] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04bdb594800028024c1812b6","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04bdb594800028024c1812b6: start","job_status":"start","queue_duration_s":0.33655,"scheduling_latency_s":0.336571}1655gitlab # [ 194.791254] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04bdb594800028024c1812b6","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04bdb594800028024c1812b6: done: 0.01524 sec","job_status":"done","queue_duration_s":0.33655,"scheduling_latency_s":0.336571,"redis_calls":13,"redis_duration_s":0.0032440000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002308,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01524,"completed_at":"2026-07-06T10:57:07.019Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1656gitlab # [ 194.795187] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e005ac8da4e336c213050f28","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e005ac8da4e336c213050f28: start","job_status":"start","queue_duration_s":0.353061,"scheduling_latency_s":0.353083}1657gitlab # [ 194.866172] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e005ac8da4e336c213050f28","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e005ac8da4e336c213050f28: done: 0.01495 sec","job_status":"done","queue_duration_s":0.353061,"scheduling_latency_s":0.353083,"redis_calls":13,"redis_duration_s":0.003047,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01495,"completed_at":"2026-07-06T10:57:07.035Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1658gitlab # [ 194.871431] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bd4c0f871c1c0b202debe85","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bd4c0f871c1c0b202debe85: start","job_status":"start","queue_duration_s":0.369314,"scheduling_latency_s":0.369337}1659gitlab # [ 194.943264] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bd4c0f871c1c0b202debe85","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bd4c0f871c1c0b202debe85: done: 0.015427 sec","job_status":"done","queue_duration_s":0.369314,"scheduling_latency_s":0.369337,"redis_calls":13,"redis_duration_s":0.003131,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015427,"completed_at":"2026-07-06T10:57:07.052Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1660gitlab # [ 194.948158] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83102aa6d98941508a81fb03","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83102aa6d98941508a81fb03: start","job_status":"start","queue_duration_s":0.38607,"scheduling_latency_s":0.386091}1661gitlab # [ 194.967189] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83102aa6d98941508a81fb03","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83102aa6d98941508a81fb03: done: 0.014993 sec","job_status":"done","queue_duration_s":0.38607,"scheduling_latency_s":0.386091,"redis_calls":13,"redis_duration_s":0.003025,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014993,"completed_at":"2026-07-06T10:57:07.068Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1662gitlab # [ 195.039938] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00760a31b1d45c61b2bf48fa","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00760a31b1d45c61b2bf48fa: start","job_status":"start","queue_duration_s":0.402388,"scheduling_latency_s":0.40241}1663gitlab # [ 195.043422] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00760a31b1d45c61b2bf48fa","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00760a31b1d45c61b2bf48fa: done: 0.015087 sec","job_status":"done","queue_duration_s":0.402388,"scheduling_latency_s":0.40241,"redis_calls":13,"redis_duration_s":0.0029560000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001036,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015087,"completed_at":"2026-07-06T10:57:07.084Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664gitlab # [ 195.115946] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e81678435214b773ad8cc08c","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e81678435214b773ad8cc08c: start","job_status":"start","queue_duration_s":0.418845,"scheduling_latency_s":0.418866}1665gitlab # [ 195.120375] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e81678435214b773ad8cc08c","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e81678435214b773ad8cc08c: done: 0.015352 sec","job_status":"done","queue_duration_s":0.418845,"scheduling_latency_s":0.418866,"redis_calls":13,"redis_duration_s":0.002902,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015352,"completed_at":"2026-07-06T10:57:07.101Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1666gitlab # [ 195.194391] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b6fc9f8a510e897cd784e40","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b6fc9f8a510e897cd784e40: start","job_status":"start","queue_duration_s":0.435483,"scheduling_latency_s":0.435505}1667gitlab # [ 195.197262] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b6fc9f8a510e897cd784e40","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b6fc9f8a510e897cd784e40: done: 0.01548 sec","job_status":"done","queue_duration_s":0.435483,"scheduling_latency_s":0.435505,"redis_calls":13,"redis_duration_s":0.003228,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000993,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002235,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01548,"completed_at":"2026-07-06T10:57:07.118Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1668gitlab # [ 195.272968] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1da8ab4a545c32cbfa05aa8","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1da8ab4a545c32cbfa05aa8: start","job_status":"start","queue_duration_s":0.452258,"scheduling_latency_s":0.452281}1669gitlab # [ 195.274324] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1da8ab4a545c32cbfa05aa8","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1da8ab4a545c32cbfa05aa8: done: 0.014953 sec","job_status":"done","queue_duration_s":0.452258,"scheduling_latency_s":0.452281,"redis_calls":13,"redis_duration_s":0.0030480000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014953,"completed_at":"2026-07-06T10:57:07.134Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670gitlab # [ 195.351063] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96d8ffc5f1b37a9419f361f9","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96d8ffc5f1b37a9419f361f9: start","job_status":"start","queue_duration_s":0.468607,"scheduling_latency_s":0.468628}1671gitlab # [ 195.352353] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96d8ffc5f1b37a9419f361f9","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96d8ffc5f1b37a9419f361f9: done: 0.017354 sec","job_status":"done","queue_duration_s":0.468607,"scheduling_latency_s":0.468628,"redis_calls":13,"redis_duration_s":0.002976,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017354,"completed_at":"2026-07-06T10:57:07.153Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1672gitlab # [ 195.451279] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"418eafbdfdb3f24615b15223","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-418eafbdfdb3f24615b15223: start","job_status":"start","queue_duration_s":0.487275,"scheduling_latency_s":0.487297}1673gitlab # [ 195.452877] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"418eafbdfdb3f24615b15223","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-418eafbdfdb3f24615b15223: done: 0.015048 sec","job_status":"done","queue_duration_s":0.487275,"scheduling_latency_s":0.487297,"redis_calls":13,"redis_duration_s":0.0028980000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015048,"completed_at":"2026-07-06T10:57:07.169Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1674gitlab # [ 195.526082] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb6a1fcd199507d4b2e2ccfe","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb6a1fcd199507d4b2e2ccfe: start","job_status":"start","queue_duration_s":0.503756,"scheduling_latency_s":0.503777}1675gitlab # [ 195.527383] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb6a1fcd199507d4b2e2ccfe","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb6a1fcd199507d4b2e2ccfe: done: 0.014996 sec","job_status":"done","queue_duration_s":0.503756,"scheduling_latency_s":0.503777,"redis_calls":13,"redis_duration_s":0.003014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014996,"completed_at":"2026-07-06T10:57:07.186Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1676gitlab # [ 195.564268] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39bc39f2662a411bbc4a497a","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39bc39f2662a411bbc4a497a: start","job_status":"start","queue_duration_s":0.520121,"scheduling_latency_s":0.520143}1677gitlab # [ 195.638123] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39bc39f2662a411bbc4a497a","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39bc39f2662a411bbc4a497a: done: 0.014988 sec","job_status":"done","queue_duration_s":0.520121,"scheduling_latency_s":0.520143,"redis_calls":13,"redis_duration_s":0.002947,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014988,"completed_at":"2026-07-06T10:57:07.202Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1678gitlab # [ 195.640379] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7fbe24937136066ab4176e2","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7fbe24937136066ab4176e2: start","job_status":"start","queue_duration_s":0.53641,"scheduling_latency_s":0.536432}1679gitlab # [ 195.717739] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7fbe24937136066ab4176e2","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7fbe24937136066ab4176e2: done: 0.020424 sec","job_status":"done","queue_duration_s":0.53641,"scheduling_latency_s":0.536432,"redis_calls":13,"redis_duration_s":0.003574,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001257,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002317,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020424,"completed_at":"2026-07-06T10:57:07.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1680gitlab # [ 195.719304] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af9b9d199b3bacb335ece59d","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af9b9d199b3bacb335ece59d: start","job_status":"start","queue_duration_s":0.558206,"scheduling_latency_s":0.558228}1681gitlab # [ 195.784150] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af9b9d199b3bacb335ece59d","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af9b9d199b3bacb335ece59d: done: 0.015618 sec","job_status":"done","queue_duration_s":0.558206,"scheduling_latency_s":0.558228,"redis_calls":13,"redis_duration_s":0.003032,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015618,"completed_at":"2026-07-06T10:57:07.241Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1682gitlab # [ 195.795340] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa07c48f1151c7fbb4a346a3","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa07c48f1151c7fbb4a346a3: start","job_status":"start","queue_duration_s":0.57514,"scheduling_latency_s":0.575161}1683gitlab # [ 195.874202] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa07c48f1151c7fbb4a346a3","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa07c48f1151c7fbb4a346a3: done: 0.015001 sec","job_status":"done","queue_duration_s":0.57514,"scheduling_latency_s":0.575161,"redis_calls":13,"redis_duration_s":0.002951,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015001,"completed_at":"2026-07-06T10:57:07.257Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1684gitlab # [ 195.876241] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"507ad01e420af5731157bb47","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-507ad01e420af5731157bb47: start","job_status":"start","queue_duration_s":0.591458,"scheduling_latency_s":0.591479}1685gitlab # [ 195.950101] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"507ad01e420af5731157bb47","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-507ad01e420af5731157bb47: done: 0.014946 sec","job_status":"done","queue_duration_s":0.591458,"scheduling_latency_s":0.591479,"redis_calls":13,"redis_duration_s":0.002995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002068,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014946,"completed_at":"2026-07-06T10:57:07.273Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1686gitlab # [ 195.952111] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21f2ffe151058039c13ea65e","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21f2ffe151058039c13ea65e: start","job_status":"start","queue_duration_s":0.607821,"scheduling_latency_s":0.607842}1687gitlab # [ 195.967348] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21f2ffe151058039c13ea65e","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21f2ffe151058039c13ea65e: done: 0.014856 sec","job_status":"done","queue_duration_s":0.607821,"scheduling_latency_s":0.607842,"redis_calls":13,"redis_duration_s":0.002969,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014856,"completed_at":"2026-07-06T10:57:07.290Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1688gitlab # [ 196.044987] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baafaa8559fe07500f3b0150","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baafaa8559fe07500f3b0150: start","job_status":"start","queue_duration_s":0.624016,"scheduling_latency_s":0.624038}1689gitlab # [ 196.046346] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baafaa8559fe07500f3b0150","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baafaa8559fe07500f3b0150: done: 0.014906 sec","job_status":"done","queue_duration_s":0.624016,"scheduling_latency_s":0.624038,"redis_calls":13,"redis_duration_s":0.002972,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014906,"completed_at":"2026-07-06T10:57:07.306Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1690gitlab # [ 196.120113] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f371cff9119fc65920aeec30","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f371cff9119fc65920aeec30: start","job_status":"start","queue_duration_s":0.640328,"scheduling_latency_s":0.640349}1691gitlab # [ 196.121190] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f371cff9119fc65920aeec30","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f371cff9119fc65920aeec30: done: 0.015584 sec","job_status":"done","queue_duration_s":0.640328,"scheduling_latency_s":0.640349,"redis_calls":13,"redis_duration_s":0.003233,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002213,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015584,"completed_at":"2026-07-06T10:57:07.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1692gitlab # [ 196.199397] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e889738c136998ccbb52ae3e","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e889738c136998ccbb52ae3e: start","job_status":"start","queue_duration_s":0.657222,"scheduling_latency_s":0.657243}1693gitlab # [ 196.200771] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e889738c136998ccbb52ae3e","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e889738c136998ccbb52ae3e: done: 0.014891 sec","job_status":"done","queue_duration_s":0.657222,"scheduling_latency_s":0.657243,"redis_calls":13,"redis_duration_s":0.0030280000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014891,"completed_at":"2026-07-06T10:57:07.339Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1694gitlab # [ 196.274229] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77735a95016d3d49bbc16da3","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77735a95016d3d49bbc16da3: start","job_status":"start","queue_duration_s":0.673479,"scheduling_latency_s":0.673501}1695gitlab # [ 196.275759] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77735a95016d3d49bbc16da3","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77735a95016d3d49bbc16da3: done: 0.014896 sec","job_status":"done","queue_duration_s":0.673479,"scheduling_latency_s":0.673501,"redis_calls":13,"redis_duration_s":0.00299,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014896,"completed_at":"2026-07-06T10:57:07.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1696gitlab # [ 196.346923] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7703cd19fde4becdc8bf7491","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7703cd19fde4becdc8bf7491: start","job_status":"start","queue_duration_s":0.68969,"scheduling_latency_s":0.689713}1697gitlab # [ 196.350206] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7703cd19fde4becdc8bf7491","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7703cd19fde4becdc8bf7491: done: 0.014941 sec","job_status":"done","queue_duration_s":0.68969,"scheduling_latency_s":0.689713,"redis_calls":13,"redis_duration_s":0.0030440000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014941,"completed_at":"2026-07-06T10:57:07.371Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1698gitlab # [ 196.416287] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.373Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d639e8c68f8a8da06262a0f3","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d639e8c68f8a8da06262a0f3: start","job_status":"start","queue_duration_s":0.705938,"scheduling_latency_s":0.70596}1699gitlab # [ 196.426777] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d639e8c68f8a8da06262a0f3","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d639e8c68f8a8da06262a0f3: done: 0.014902 sec","job_status":"done","queue_duration_s":0.705938,"scheduling_latency_s":0.70596,"redis_calls":13,"redis_duration_s":0.0029790000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014902,"completed_at":"2026-07-06T10:57:07.388Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1700gitlab # [ 196.494337] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b1620d78989bac74fcf7705","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b1620d78989bac74fcf7705: start","job_status":"start","queue_duration_s":0.722138,"scheduling_latency_s":0.722159}1701gitlab # [ 196.503796] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b1620d78989bac74fcf7705","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b1620d78989bac74fcf7705: done: 0.015303 sec","job_status":"done","queue_duration_s":0.722138,"scheduling_latency_s":0.722159,"redis_calls":13,"redis_duration_s":0.003119,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002142,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015303,"completed_at":"2026-07-06T10:57:07.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1702gitlab # [ 196.574827] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4920e06b06da96cb15ac070f","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4920e06b06da96cb15ac070f: start","job_status":"start","queue_duration_s":0.738812,"scheduling_latency_s":0.738833}1703gitlab # [ 196.580075] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4920e06b06da96cb15ac070f","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4920e06b06da96cb15ac070f: done: 0.019104 sec","job_status":"done","queue_duration_s":0.738812,"scheduling_latency_s":0.738833,"redis_calls":13,"redis_duration_s":0.005150999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00114,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019104,"completed_at":"2026-07-06T10:57:07.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1704gitlab # [ 196.654835] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c97c2346ea1fe70d668fa5b","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c97c2346ea1fe70d668fa5b: start","job_status":"start","queue_duration_s":0.759317,"scheduling_latency_s":0.759338}1705gitlab # [ 196.657061] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c97c2346ea1fe70d668fa5b","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c97c2346ea1fe70d668fa5b: done: 0.014958 sec","job_status":"done","queue_duration_s":0.759317,"scheduling_latency_s":0.759338,"redis_calls":13,"redis_duration_s":0.002905,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014958,"completed_at":"2026-07-06T10:57:07.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1706gitlab # [ 196.731908] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a8a71f5122889f3483269f4","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a8a71f5122889f3483269f4: start","job_status":"start","queue_duration_s":0.775566,"scheduling_latency_s":0.775588}1707gitlab # [ 196.733735] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a8a71f5122889f3483269f4","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a8a71f5122889f3483269f4: done: 0.014928 sec","job_status":"done","queue_duration_s":0.775566,"scheduling_latency_s":0.775588,"redis_calls":13,"redis_duration_s":0.003111,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002159,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014928,"completed_at":"2026-07-06T10:57:07.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1708gitlab # [ 196.801893] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e290efe1a44b66fb5e6b97d","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e290efe1a44b66fb5e6b97d: start","job_status":"start","queue_duration_s":0.791846,"scheduling_latency_s":0.791868}1709gitlab # [ 196.809721] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e290efe1a44b66fb5e6b97d","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e290efe1a44b66fb5e6b97d: done: 0.014718 sec","job_status":"done","queue_duration_s":0.791846,"scheduling_latency_s":0.791868,"redis_calls":13,"redis_duration_s":0.002953,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014718,"completed_at":"2026-07-06T10:57:07.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1710gitlab # [ 196.889106] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b81fcf8f6a4bbaa0b4a6edd2","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b81fcf8f6a4bbaa0b4a6edd2: start","job_status":"start","queue_duration_s":0.80791,"scheduling_latency_s":0.80793}1711gitlab # [ 196.890373] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b81fcf8f6a4bbaa0b4a6edd2","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b81fcf8f6a4bbaa0b4a6edd2: done: 0.014826 sec","job_status":"done","queue_duration_s":0.80791,"scheduling_latency_s":0.80793,"redis_calls":13,"redis_duration_s":0.002833,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014826,"completed_at":"2026-07-06T10:57:07.490Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1712gitlab # [ 196.956393] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e239e397f8976ec9c29b045","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e239e397f8976ec9c29b045: start","job_status":"start","queue_duration_s":0.824024,"scheduling_latency_s":0.824046}1713gitlab # [ 197.023263] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e239e397f8976ec9c29b045","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e239e397f8976ec9c29b045: done: 0.014749 sec","job_status":"done","queue_duration_s":0.824024,"scheduling_latency_s":0.824046,"redis_calls":13,"redis_duration_s":0.00286,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014749,"completed_at":"2026-07-06T10:57:07.506Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1714gitlab # [ 197.025203] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1274030f285ac855f5462585","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1274030f285ac855f5462585: start","job_status":"start","queue_duration_s":0.840046,"scheduling_latency_s":0.840068}1715gitlab # [ 197.097298] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1274030f285ac855f5462585","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1274030f285ac855f5462585: done: 0.017453 sec","job_status":"done","queue_duration_s":0.840046,"scheduling_latency_s":0.840068,"redis_calls":13,"redis_duration_s":0.00554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00404,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017453,"completed_at":"2026-07-06T10:57:07.524Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1716gitlab # [ 197.099054] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e724745b9dad0535b4e856a","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e724745b9dad0535b4e856a: start","job_status":"start","queue_duration_s":0.858828,"scheduling_latency_s":0.85885}1717gitlab # [ 197.165197] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e724745b9dad0535b4e856a","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e724745b9dad0535b4e856a: done: 0.014793 sec","job_status":"done","queue_duration_s":0.858828,"scheduling_latency_s":0.85885,"redis_calls":13,"redis_duration_s":0.0029319999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014793,"completed_at":"2026-07-06T10:57:07.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1718gitlab # [ 197.237258] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60ecb47d4d5ea6e7d884e5e7","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60ecb47d4d5ea6e7d884e5e7: start","job_status":"start","queue_duration_s":0.874943,"scheduling_latency_s":0.874965}1719gitlab # [ 197.238384] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60ecb47d4d5ea6e7d884e5e7","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60ecb47d4d5ea6e7d884e5e7: done: 0.014716 sec","job_status":"done","queue_duration_s":0.874943,"scheduling_latency_s":0.874965,"redis_calls":13,"redis_duration_s":0.002873,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014716,"completed_at":"2026-07-06T10:57:07.557Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1720gitlab # [ 197.304240] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"438f16fa16d92962b5b9f118","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-438f16fa16d92962b5b9f118: start","job_status":"start","queue_duration_s":0.890961,"scheduling_latency_s":0.890982}1721gitlab # [ 197.305936] runuser[2748]: pam_unix(runuser:session): session closed for user gitlab1722gitlab # [ 197.307482] setup-gitlab-start[2966]: ++ jq -r .token1723gitlab # [ 197.308763] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"438f16fa16d92962b5b9f118","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-438f16fa16d92962b5b9f118: done: 0.01483 sec","job_status":"done","queue_duration_s":0.890961,"scheduling_latency_s":0.890982,"redis_calls":13,"redis_duration_s":0.002845,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01483,"completed_at":"2026-07-06T10:57:07.573Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1724gitlab # [ 197.380069] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9273d434ac373b85877f11cc","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9273d434ac373b85877f11cc: start","job_status":"start","queue_duration_s":0.907064,"scheduling_latency_s":0.907085}1725gitlab # [ 197.381489] setup-gitlab-start[2967]: +++ date -d '+7 days' +%F1726gitlab # [ 197.382686] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9273d434ac373b85877f11cc","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9273d434ac373b85877f11cc: done: 0.018567 sec","job_status":"done","queue_duration_s":0.907064,"scheduling_latency_s":0.907085,"redis_calls":13,"redis_duration_s":0.006670000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001232,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005438,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018567,"completed_at":"2026-07-06T10:57:07.593Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1727gitlab # [ 197.413415] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc498191f54ea430c68baed9","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc498191f54ea430c68baed9: start","job_status":"start","queue_duration_s":0.929096,"scheduling_latency_s":0.929118}1728gitlab # [ 197.433360] setup-gitlab-start[2965]: ++ curl -fs -X POST -H 'Authorization: Bearer 0344aa8f770a0a13a6924861f266400da8eebf78bdb6409e2783becf72605d57' -H 'Content-Type: application/json' -d '{"name":"nixbot","scopes":["api"],"expires_at":"2026-07-13"}' http://gitlab/api/v4/users/1/personal_access_tokens1729gitlab # [ 197.501363] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:07.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc498191f54ea430c68baed9","created_at":"2026-07-06T10:57:06.598Z","trace_propagation_headers":{"sentry-trace":"acca78ecab584679ab26173cb7b21a5e-d72844e9f0854f71","baggage":"sentry-trace_id=acca78ecab584679ab26173cb7b21a5e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ceae2721fc1cee849e15544b8664ab67","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:06.667Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc498191f54ea430c68baed9: done: 0.021765 sec","job_status":"done","queue_duration_s":0.929096,"scheduling_latency_s":0.929118,"redis_calls":13,"redis_duration_s":0.009285999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002234,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021765,"completed_at":"2026-07-06T10:57:07.618Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1730gitlab # [ 197.817307] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 5939003525 wd_nsec: 59390030031731gitlab # [ 197.592942] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:11.462Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"f40c52c3c33329a87aab31c4","created_at":"2026-07-06T10:57:11.431Z","trace_propagation_headers":{"sentry-trace":"daa3b2059a9941ffa86b3e078a6e661d-5017c600e86d4e8f","baggage":"sentry-trace_id=daa3b2059a9941ffa86b3e078a6e661d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6AZK2V2YNWKF6H9FR918","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:f81cdedfcacd69f5b842708be2f4e4b25f0dcbc15f4750aeabdfeba6828aa02e","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:11.459Z","job_size_bytes":451,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-f40c52c3c33329a87aab31c4: start","job_status":"start","queue_duration_s":0.002527,"scheduling_latency_s":0.002571}1732gitlab # [ 197.598573] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:11 +0000] "POST /api/v4/users/1/personal_access_tokens HTTP/1.1" 201 267 "" "curl/8.20.0" 3121733gitlab # [ 197.602833] setup-gitlab-start[2697]: + TOKEN=glpat-4wZREKrFKbhVahQddfpDRW86MQp1OjEH.01.0w0li172x1734gitlab # [ 197.604105] setup-gitlab-start[2697]: + test -n glpat-4wZREKrFKbhVahQddfpDRW86MQp1OjEH.01.0w0li172x1735gitlab # [ 197.604822] setup-gitlab-start[2697]: + test glpat-4wZREKrFKbhVahQddfpDRW86MQp1OjEH.01.0w0li172x '!=' null1736gitlab # [ 197.605982] setup-gitlab-start[2697]: + mkdir -p /var/lib/secrets1737gitlab # [ 197.607134] setup-gitlab-start[2697]: + echo glpat-4wZREKrFKbhVahQddfpDRW86MQp1OjEH.01.0w0li172x1738gitlab # [ 197.607883] setup-gitlab-start[2697]: + chmod 644 /var/lib/secrets/gitlab-token1739gitlab # [ 197.609105] setup-gitlab-start[2697]: + curl -fs -X POST -H 'PRIVATE-TOKEN: glpat-4wZREKrFKbhVahQddfpDRW86MQp1OjEH.01.0w0li172x' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1740gitlab # [ 197.685169] sidekiq-cluster[2138]: {"severity":"WARN","time":"2026-07-06T10:57:11.554Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"f40c52c3c33329a87aab31c4","created_at":"2026-07-06T10:57:11.431Z","trace_propagation_headers":{"sentry-trace":"daa3b2059a9941ffa86b3e078a6e661d-5017c600e86d4e8f","baggage":"sentry-trace_id=daa3b2059a9941ffa86b3e078a6e661d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6AZK2V2YNWKF6H9FR918","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:f81cdedfcacd69f5b842708be2f4e4b25f0dcbc15f4750aeabdfeba6828aa02e","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:11.459Z","job_size_bytes":451,"pid":2138,"sidekiq_tid":"lyse","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-f40c52c3c33329a87aab31c4: fail: 0.091559 sec","job_status":"fail","queue_duration_s":0.002527,"scheduling_latency_s":0.002571,"redis_calls":11,"redis_duration_s":0.0034779999999999998,"redis_read_bytes":137,"redis_write_bytes":1317,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001357,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00165,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000471,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000374628,"duration_s":0.091559,"completed_at":"2026-07-06T10:57:11.553Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.016114,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1741gitlab # [ 198.838110] gitaly[1386]: time="2026-07-06T10:57:12.706Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:57:22.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:12.705" pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1742gitlab # [ 198.840495] gitaly[1386]: time="2026-07-06T10:57:12.710Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:57:22.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:12.705" grpc.time_ms=1.145 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1743gitlab # [ 199.002484] gitaly[1386]: time="2026-07-06T10:57:12.872Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:57:22.171" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:12.872" pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1744gitlab # [ 199.003958] gitaly[1386]: time="2026-07-06T10:57:12.872Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:57:22.171" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:12.872" grpc.time_ms=0.305 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745gitlab # [ 199.115919] gitaly[1386]: time="2026-07-06T10:57:12.985Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 diskcache=28715e51-13cb-422a-9d4d-d0c4de1a736e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-06T10:57:22.243" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:12.944" pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1746gitlab # [ 199.117359] gitaly[1386]: time="2026-07-06T10:57:12.986Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=324 command.oublock=32 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-06T10:57:22.243" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:12.944" grpc.time_ms=40.944 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1747gitlab # [ 199.175719] gitaly[1386]: time="2026-07-06T10:57:13.045Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:57:23.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:13.044" pid=1386 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1748gitlab # [ 199.177475] gitaly[1386]: time="2026-07-06T10:57:13.045Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:57:23.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:13.044" grpc.time_ms=1.247 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1749gitlab # [ 199.224775] gitaly[1386]: time="2026-07-06T10:57:13.094Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-06T10:57:23.039" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:13.079" grpc.time_ms=14.707 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1750gitlab # [ 199.284173] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:13.152Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"999d1c662a1717a80ec5e179","created_at":"2026-07-06T10:57:13.110Z","trace_propagation_headers":{"sentry-trace":"23838613a56b471aa6aa2a477e19a1bc-1ef969e57cbd4edb","baggage":"sentry-trace_id=23838613a56b471aa6aa2a477e19a1bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6BAV1HB60HWSNWCFEQF9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:13.148Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-999d1c662a1717a80ec5e179: start","job_status":"start","queue_duration_s":0.003721,"scheduling_latency_s":0.003769}1751gitlab # [ 199.310084] gitaly[1386]: time="2026-07-06T10:57:13.179Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:57:23.138" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:13.179" pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1752gitlab # [ 199.311492] gitaly[1386]: time="2026-07-06T10:57:13.180Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:57:23.138" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:13.179" grpc.time_ms=0.516 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1753gitlab # [ 199.353955] gitaly[1386]: time="2026-07-06T10:57:13.223Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 diskcache=ec8f303c-d4fa-4365-91b3-f21335c38b29 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-06T10:57:23.146" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:13.187" pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1754gitlab # [ 199.355333] gitaly[1386]: time="2026-07-06T10:57:13.224Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=325 command.oublock=32 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-06T10:57:23.146" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:13.187" grpc.time_ms=36.481 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1755gitlab # [ 199.380696] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:13.250Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"999d1c662a1717a80ec5e179","created_at":"2026-07-06T10:57:13.110Z","trace_propagation_headers":{"sentry-trace":"23838613a56b471aa6aa2a477e19a1bc-1ef969e57cbd4edb","baggage":"sentry-trace_id=23838613a56b471aa6aa2a477e19a1bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6BAV1HB60HWSNWCFEQF9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:13.148Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-999d1c662a1717a80ec5e179: done: 0.097494 sec","job_status":"done","queue_duration_s":0.003721,"scheduling_latency_s":0.003769,"redis_calls":12,"redis_duration_s":0.006484,"redis_read_bytes":10,"redis_write_bytes":1430,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001325,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":265,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002689,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.040722773,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.097494,"completed_at":"2026-07-06T10:57:13.249Z","load_balancing_strategy":"primary","db_duration_s":0.015357,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1756gitlab # [ 199.392654] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:13.251Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"1df6aff69e8c9b88ec94f41e","created_at":"2026-07-06T10:57:13.157Z","trace_propagation_headers":{"sentry-trace":"23838613a56b471aa6aa2a477e19a1bc-1ef969e57cbd4edb","baggage":"sentry-trace_id=23838613a56b471aa6aa2a477e19a1bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6BAV1HB60HWSNWCFEQF9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:13.170Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-1df6aff69e8c9b88ec94f41e: start","job_status":"start","queue_duration_s":0.081573,"scheduling_latency_s":0.081597}1757gitlab # [ 199.467244] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:13.336Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"1df6aff69e8c9b88ec94f41e","created_at":"2026-07-06T10:57:13.157Z","trace_propagation_headers":{"sentry-trace":"23838613a56b471aa6aa2a477e19a1bc-1ef969e57cbd4edb","baggage":"sentry-trace_id=23838613a56b471aa6aa2a477e19a1bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6BAV1HB60HWSNWCFEQF9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:13.170Z","job_size_bytes":2,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-1df6aff69e8c9b88ec94f41e: done: 0.085026 sec","job_status":"done","queue_duration_s":0.081573,"scheduling_latency_s":0.081597,"redis_calls":14,"redis_duration_s":0.005,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000734,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00241,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001856,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.060611333999999996,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.085026,"completed_at":"2026-07-06T10:57:13.336Z","load_balancing_strategy":"primary","db_duration_s":0.021759,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1758gitlab # [ 199.559916] gitaly[1386]: time="2026-07-06T10:57:13.429Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:57:23.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:13.429" pid=1386 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1759gitlab # [ 199.560848] gitaly[1386]: time="2026-07-06T10:57:13.430Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:57:23.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:13.429" grpc.time_ms=0.503 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1760gitlab # [ 199.575336] gitaly[1386]: time="2026-07-06T10:57:13.445Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-06T10:57:23.014" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:13.434" grpc.time_ms=9.943 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1761gitlab # [ 199.647167] gitaly[1386]: time="2026-07-06T10:57:13.516Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:57:23.095" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:13.516" grpc.time_ms=0.347 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762gitlab # [ 199.672653] gitaly[1386]: time="2026-07-06T10:57:13.542Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-06T10:57:23.120" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:13.541" grpc.time_ms=0.492 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763gitlab # [ 199.865205] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:13.733Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"b872147382c6a1ab68102bda","created_at":"2026-07-06T10:57:13.724Z","trace_propagation_headers":{"sentry-trace":"23838613a56b471aa6aa2a477e19a1bc-1ef969e57cbd4edb","baggage":"sentry-trace_id=23838613a56b471aa6aa2a477e19a1bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6BAV1HB60HWSNWCFEQF9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:13.731Z","job_size_bytes":5,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-b872147382c6a1ab68102bda: start","job_status":"start","queue_duration_s":0.002126,"scheduling_latency_s":0.002172}1764gitlab # [ 200.060985] gitaly[1386]: time="2026-07-06T10:57:13.929Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6BAV1HB60HWSNWCFEQF9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-06T10:57:23.215" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:13.915" grpc.time_ms=13.646 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765gitlab # [ 200.063483] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:13.932Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"b872147382c6a1ab68102bda","created_at":"2026-07-06T10:57:13.724Z","trace_propagation_headers":{"sentry-trace":"23838613a56b471aa6aa2a477e19a1bc-1ef969e57cbd4edb","baggage":"sentry-trace_id=23838613a56b471aa6aa2a477e19a1bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6BAV1HB60HWSNWCFEQF9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:13.731Z","job_size_bytes":5,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-b872147382c6a1ab68102bda: done: 0.199109 sec","job_status":"done","queue_duration_s":0.002126,"scheduling_latency_s":0.002172,"redis_calls":12,"redis_duration_s":0.00562,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00145,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003224,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000601752,"duration_s":0.199109,"completed_at":"2026-07-06T10:57:13.932Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027202,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1766gitlab # [ 200.181459] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:14.049Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"5fe814c865f308cb45920a13","created_at":"2026-07-06T10:57:13.846Z","trace_propagation_headers":{"sentry-trace":"23838613a56b471aa6aa2a477e19a1bc-1ef969e57cbd4edb","baggage":"sentry-trace_id=23838613a56b471aa6aa2a477e19a1bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6BAV1HB60HWSNWCFEQF9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:13.856Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-5fe814c865f308cb45920a13: start","job_status":"start","queue_duration_s":0.192386,"scheduling_latency_s":0.192463}1767gitlab # [ 200.463319] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:14.331Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"5fe814c865f308cb45920a13","created_at":"2026-07-06T10:57:13.846Z","trace_propagation_headers":{"sentry-trace":"23838613a56b471aa6aa2a477e19a1bc-1ef969e57cbd4edb","baggage":"sentry-trace_id=23838613a56b471aa6aa2a477e19a1bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6BAV1HB60HWSNWCFEQF9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:13.856Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-5fe814c865f308cb45920a13: done: 0.282566 sec","job_status":"done","queue_duration_s":0.192386,"scheduling_latency_s":0.192463,"redis_calls":11,"redis_duration_s":0.00649,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001787,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003545,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001158,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.191,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.191,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.150846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000557333,"duration_s":0.282566,"completed_at":"2026-07-06T10:57:14.331Z","load_balancing_strategy":"primary","db_duration_s":0.104774,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1768gitlab # [ 200.567299] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:14.335Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"eede34a4a5a2a4f725633565","created_at":"2026-07-06T10:57:13.862Z","trace_propagation_headers":{"sentry-trace":"23838613a56b471aa6aa2a477e19a1bc-1ef969e57cbd4edb","baggage":"sentry-trace_id=23838613a56b471aa6aa2a477e19a1bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6BAV1HB60HWSNWCFEQF9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:13.872Z","job_size_bytes":89,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-eede34a4a5a2a4f725633565: start","job_status":"start","queue_duration_s":0.463294,"scheduling_latency_s":0.463368}1769gitlab # [ 200.594253] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:14 +0000] "POST /api/v4/projects HTTP/1.1" 201 4795 "" "curl/8.20.0" 29121770gitlab # [ 200.594861] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:14.455Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"eede34a4a5a2a4f725633565","created_at":"2026-07-06T10:57:13.862Z","trace_propagation_headers":{"sentry-trace":"23838613a56b471aa6aa2a477e19a1bc-1ef969e57cbd4edb","baggage":"sentry-trace_id=23838613a56b471aa6aa2a477e19a1bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6BAV1HB60HWSNWCFEQF9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:13.872Z","job_size_bytes":89,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-eede34a4a5a2a4f725633565: done: 0.119969 sec","job_status":"done","queue_duration_s":0.463294,"scheduling_latency_s":0.463368,"redis_calls":11,"redis_duration_s":0.00359,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001052,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001942,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000429664,"duration_s":0.119969,"completed_at":"2026-07-06T10:57:14.454Z","load_balancing_strategy":"primary","db_duration_s":0.034649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1771gitlab # [ 200.665540] setup-gitlab-start[2697]: + mkdir -p /tmp/test-flake1772gitlab # [ 200.667443] setup-gitlab-start[2697]: + cd /tmp/test-flake1773gitlab # [ 200.668231] setup-gitlab-start[2697]: + git init -b master1774gitlab # [ 200.690601] setup-gitlab-start[3016]: Initialized empty Git repository in /tmp/test-flake/.git/1775gitlab # [ 200.691322] setup-gitlab-start[2697]: + git config user.name test1776gitlab # [ 200.696571] setup-gitlab-start[2697]: + git config user.email test@example.com1777gitlab # [ 200.701327] setup-gitlab-start[2697]: + cat1778gitlab # [ 200.703564] setup-gitlab-start[2697]: + git add flake.nix1779gitlab # [ 200.707800] setup-gitlab-start[2697]: + git commit -m 'initial commit'1780gitlab # [ 200.724541] setup-gitlab-start[3021]: [master (root-commit) 14bed34] initial commit1781gitlab # [ 200.725588] setup-gitlab-start[3021]: 1 file changed, 10 insertions(+)1782gitlab # [ 200.727318] setup-gitlab-start[3021]: create mode 100644 flake.nix1783gitlab # [ 200.729107] setup-gitlab-start[2697]: + git remote add origin http://oauth2:glpat-4wZREKrFKbhVahQddfpDRW86MQp1OjEH.01.0w0li172x@gitlab/root/test-flake.git1784gitlab # [ 200.741385] setup-gitlab-start[2697]: + git push -u origin master1785gitlab # [ 200.816941] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:14 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 391786gitlab # [ 200.930690] gitaly[1386]: time="2026-07-06T10:57:14.800Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EE895QX60RWBDMTC4XZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:14.784" grpc.time_ms=15.645 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1787gitlab # [ 200.975729] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:14 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.54.0" 1481788gitlab # [ 201.237744] gitaly[1386]: time="2026-07-06T10:57:15.106Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-06T10:57:25.054" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:15.095" grpc.time_ms=10.942 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1789gitlab # [ 201.324201] gitaly[1386]: time="2026-07-06T10:57:15.193Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-06T10:57:45.080" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-06T10:57:15.181" grpc.time_ms=12.169 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790gitlab # [ 201.376572] gitaly[1386]: time="2026-07-06T10:57:15.246Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF duration_ms=212ns method=POST pid=1386 status=200 url="http://unix/api/v4/internal/allowed"1791gitlab # [ 201.402401] gitaly[1386]: time="2026-07-06T10:57:15.272Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF duration_ms=24ns method=POST pid=1386 status=200 url="http://unix/api/v4/internal/pre_receive"1792gitlab # [ 201.403347] gitaly[1386]: time="2026-07-06T10:57:15.273Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5319 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:15.032" grpc.time_ms=240.652 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1793gitlab # [ 201.478699] gitaly[1386]: time="2026-07-06T10:57:15.348Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4789 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:15.346" grpc.time_ms=1.625 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1794gitlab # [ 201.534480] gitaly[1386]: time="2026-07-06T10:57:15.403Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4788 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:15.403" grpc.time_ms=0.604 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1795gitlab # [ 201.582394] gitaly[1386]: time="2026-07-06T10:57:15.452Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4790 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:15.451" grpc.time_ms=0.398 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1796gitlab # [ 201.725835] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:15.594Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 14bed34b441f0f8265254b37fea84aefed9c08c4 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a373c467ca0b99efb98d6c09","created_at":"2026-07-06T10:57:15.586Z","trace_propagation_headers":{"sentry-trace":"1646528764364ebfbddf2a4653f8a3fc-f856e9ad3e6b47f5","baggage":"sentry-trace_id=1646528764364ebfbddf2a4653f8a3fc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6EKFCD8DQHS6JGS5MPJF","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:15.592Z","job_size_bytes":185,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a373c467ca0b99efb98d6c09: start","job_status":"start","queue_duration_s":0.001997,"scheduling_latency_s":0.00204}1797gitlab # [ 201.744480] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:15.614Z","message":"changes: \"0000000000000000000000000000000000000000 14bed34b441f0f8265254b37fea84aefed9c08c4 refs/heads/master\\n\""}1798gitlab # [ 201.790311] gitaly[1386]: time="2026-07-06T10:57:15.659Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-06T10:57:25.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:15.649" grpc.time_ms=9.857 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 201.823412] gitaly[1386]: time="2026-07-06T10:57:15.693Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:57:25.038" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:15.679" grpc.time_ms=13.987 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800gitlab # [ 201.845677] gitaly[1386]: time="2026-07-06T10:57:15.715Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-06T10:57:25.059" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:15.700" grpc.time_ms=15.074 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801gitlab # [ 201.894044] gitaly[1386]: time="2026-07-06T10:57:15.762Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-06T10:57:25.109" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:15.750" grpc.time_ms=11.772 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1802gitlab # [ 201.942768] gitaly[1386]: time="2026-07-06T10:57:15.812Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3940 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:15.812" grpc.time_ms=0.371 pid=1386 span.kind=server system=grpc1803gitlab # [ 201.968559] gitaly[1386]: time="2026-07-06T10:57:15.838Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1564 command.oublock=0 command.real_time_ms=34 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-06T10:57:25.008" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:15.798" grpc.time_ms=39.072 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 201.986080] gitaly[1386]: time="2026-07-06T10:57:15.855Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3942 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:15.855" grpc.time_ms=0.376 pid=1386 span.kind=server system=grpc1805gitlab # [ 201.991867] gitaly[1386]: time="2026-07-06T10:57:15.861Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF duration_ms=369ns method=POST pid=1386 status=200 url="http://unix/api/v4/internal/post_receive"1806gitlab # [ 201.992902] gitaly[1386]: time="2026-07-06T10:57:15.862Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4813 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:15.490" grpc.time_ms=371.294 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1807gitlab # [ 202.036459] gitaly[1386]: time="2026-07-06T10:57:15.906Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF diskcache=753fff04-10af-4cfa-a4b1-aa1a483af1e1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:14.939" pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1808gitlab # [ 202.052932] gitaly[1386]: time="2026-07-06T10:57:15.922Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=275 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13371 command.oublock=32 command.real_time_ms=952 command.spawn_token_fork_ms=1 command.system_time_ms=178 command.user_time_ms=97 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:14.939" grpc.time_ms=982.71 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1809gitlab # [ 202.074675] gitlab-workhorse[1287]: time="2026-07-06T10:57:15Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521810gitlab # [ 202.075713] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:15 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 10801811gitlab # [ 202.081068] gitaly[1386]: time="2026-07-06T10:57:15.922Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF diskcache=70d7fc87-b102-4f3e-b545-6a223d1e0519 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-06T10:57:25.142" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:15.783" pid=1386 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1812gitlab # [ 202.082643] setup-gitlab-start[3025]: To http://gitlab/root/test-flake.git1813gitlab # [ 202.083809] setup-gitlab-start[3025]: * [new branch] master -> master1814gitlab # [ 202.084926] gitaly[1386]: time="2026-07-06T10:57:15.951Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=94 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4714 command.oublock=8 command.real_time_ms=113 command.spawn_token_fork_ms=1 command.system_time_ms=72 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-06T10:57:25.142" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:15.783" grpc.time_ms=167.516 pid=1386 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1815gitlab # [ 202.120715] setup-gitlab-start[3025]: branch 'master' set up to track 'origin/master'.1816gitlab # [ 202.125746] systemd[1]: Finished setup-gitlab.service.1817gitlab # [ 202.129345] systemd[1]: Starting nixbot CI service...1818gitlab # [ 202.145618] gitaly[1386]: time="2026-07-06T10:57:16.015Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:57:26.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:16.015" grpc.time_ms=0.207 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1819gitlab # [ 202.159768] gitaly[1386]: time="2026-07-06T10:57:16.029Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=943 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-06T10:57:26.010" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:16.020" grpc.time_ms=9.052 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820gitlab # [ 202.241985] gitaly[1386]: time="2026-07-06T10:57:16.111Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=337 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-07-06T10:57:46.003" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:16.104" grpc.time_ms=6.553 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1821gitlab # [ 202.267461] gitaly[1386]: time="2026-07-06T10:57:16.135Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-06T10:57:26.124" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:16.134" grpc.time_ms=0.517 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1822gitlab # [ 202.273171] gitaly[1386]: time="2026-07-06T10:57:16.143Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-06T10:57:26.128" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-07-06T10:57:16.138" grpc.time_ms=4.524 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1823gitlab # [ 202.332588] gitaly[1386]: time="2026-07-06T10:57:16.202Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:57:26.184" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:16.194" grpc.time_ms=7.225 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1824gitlab # [ 202.344428] gitaly[1386]: time="2026-07-06T10:57:16.214Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:57:26.196" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:16.207" grpc.time_ms=6.574 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1825gitlab # [ 202.368846] gitaly[1386]: time="2026-07-06T10:57:16.238Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=969 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-06T10:57:46.124" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:16.225" grpc.time_ms=13.013 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1826gitlab: (finished: waiting for unit setup-gitlab.service, in 203.55 seconds)1827gitlab: waiting for unit nixbot.service1828gitlab # [ 202.692692] gitaly[1386]: time="2026-07-06T10:57:16.562Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-06T10:57:26.009" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:16.559" grpc.time_ms=2.582 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1829gitlab # [ 202.802972] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:16.671Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 14bed34b441f0f8265254b37fea84aefed9c08c4 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a373c467ca0b99efb98d6c09","created_at":"2026-07-06T10:57:15.586Z","trace_propagation_headers":{"sentry-trace":"1646528764364ebfbddf2a4653f8a3fc-f856e9ad3e6b47f5","baggage":"sentry-trace_id=1646528764364ebfbddf2a4653f8a3fc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6EKFCD8DQHS6JGS5MPJF","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:15.592Z","job_size_bytes":185,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a373c467ca0b99efb98d6c09: done: 1.077275 sec","job_status":"done","queue_duration_s":0.001997,"scheduling_latency_s":0.00204,"gitaly_calls":14,"gitaly_duration_s":0.451424,"redis_calls":204,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.076063,"redis_read_bytes":1052,"redis_write_bytes":20226,"redis_cache_calls":14,"redis_cache_duration_s":0.004357,"redis_cache_read_bytes":16,"redis_cache_write_bytes":884,"redis_feature_flag_calls":35,"redis_feature_flag_duration_s":0.014447,"redis_feature_flag_read_bytes":670,"redis_feature_flag_write_bytes":4621,"redis_queues_calls":8,"redis_queues_duration_s":0.001487,"redis_queues_read_bytes":8,"redis_queues_write_bytes":4935,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003429,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":92,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.03259,"redis_repository_cache_read_bytes":214,"redis_repository_cache_write_bytes":6392,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.019753,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":52,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":52,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.232,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.263,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.061,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.467652,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000811556,"exclusive_lock_hold_duration_s":0.033486379000000004,"duration_s":1.077275,"completed_at":"2026-07-06T10:57:16.671Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.091429,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1830gitlab # [ 202.900605] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:16.769Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"70ac953f6815608b6fbb277b","created_at":"2026-07-06T10:57:15.717Z","trace_propagation_headers":{"sentry-trace":"1646528764364ebfbddf2a4653f8a3fc-0a436e79c8a74d06","baggage":"sentry-trace_id=1646528764364ebfbddf2a4653f8a3fc,sentry-release=Unknown"},"correlation_id":"01KWVH6EKFCD8DQHS6JGS5MPJF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:15.723Z","job_size_bytes":46,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-70ac953f6815608b6fbb277b: start","job_status":"start","queue_duration_s":1.046744,"scheduling_latency_s":1.046792}1831gitlab # [ 202.986322] gitaly[1386]: time="2026-07-06T10:57:16.856Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-07-06T16:57:16.852" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:16.853" grpc.time_ms=2.35 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1832gitlab # [ 203.001052] gitaly[1386]: time="2026-07-06T10:57:16.870Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-06T10:57:46.762" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:16.863" grpc.time_ms=7.361 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1833gitlab # [ 203.025733] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:16.895Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"70ac953f6815608b6fbb277b","created_at":"2026-07-06T10:57:15.717Z","trace_propagation_headers":{"sentry-trace":"1646528764364ebfbddf2a4653f8a3fc-0a436e79c8a74d06","baggage":"sentry-trace_id=1646528764364ebfbddf2a4653f8a3fc,sentry-release=Unknown"},"correlation_id":"01KWVH6EKFCD8DQHS6JGS5MPJF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:15.723Z","job_size_bytes":46,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-70ac953f6815608b6fbb277b: done: 0.125702 sec","job_status":"done","queue_duration_s":1.046744,"scheduling_latency_s":1.046792,"gitaly_calls":2,"gitaly_duration_s":0.016263,"redis_calls":37,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.012512,"redis_read_bytes":710,"redis_write_bytes":5490,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.00441,"redis_feature_flag_read_bytes":648,"redis_feature_flag_write_bytes":1610,"redis_queues_calls":3,"redis_queues_duration_s":0.000606,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2112,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001866,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004784,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":754,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000846,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000383848,"duration_s":0.125702,"completed_at":"2026-07-06T10:57:16.895Z","load_balancing_strategy":"primary","db_duration_s":0.014745,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1834gitlab # [ 203.095854] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:16.897Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5b678c01bfdcb64ce30e55ee","created_at":"2026-07-06T10:57:15.736Z","trace_propagation_headers":{"sentry-trace":"1646528764364ebfbddf2a4653f8a3fc-0a436e79c8a74d06","baggage":"sentry-trace_id=1646528764364ebfbddf2a4653f8a3fc,sentry-release=Unknown"},"correlation_id":"01KWVH6EKFCD8DQHS6JGS5MPJF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:15.744Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5b678c01bfdcb64ce30e55ee: start","job_status":"start","queue_duration_s":1.153353,"scheduling_latency_s":1.153375}1835gitlab # [ 203.142866] gitaly[1386]: time="2026-07-06T10:57:17.012Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF diskcache=3434aa27-de6f-4688-87e0-f449f7f93acb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-06T16:57:16.918" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:16.918" pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1836gitlab # [ 203.160474] gitaly[1386]: time="2026-07-06T10:57:17.013Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1279 command.oublock=0 command.real_time_ms=91 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-06T16:57:16.918" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:16.918" grpc.time_ms=93.954 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1837gitlab # [ 203.202212] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:17.071Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5b678c01bfdcb64ce30e55ee","created_at":"2026-07-06T10:57:15.736Z","trace_propagation_headers":{"sentry-trace":"1646528764364ebfbddf2a4653f8a3fc-0a436e79c8a74d06","baggage":"sentry-trace_id=1646528764364ebfbddf2a4653f8a3fc,sentry-release=Unknown"},"correlation_id":"01KWVH6EKFCD8DQHS6JGS5MPJF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:15.744Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5b678c01bfdcb64ce30e55ee: done: 0.173856 sec","job_status":"done","queue_duration_s":1.153353,"scheduling_latency_s":1.153375,"gitaly_calls":1,"gitaly_duration_s":0.096584,"redis_calls":15,"redis_duration_s":0.003919,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000499,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001482,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000637,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001301,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.033,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.041,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.151819574,"duration_s":0.173856,"completed_at":"2026-07-06T10:57:17.071Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03866,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1838gitlab # [ 203.282170] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:17.151Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"419b34ff5828001db7e09582","created_at":"2026-07-06T10:57:16.010Z","trace_propagation_headers":{"sentry-trace":"1646528764364ebfbddf2a4653f8a3fc-0a436e79c8a74d06","baggage":"sentry-trace_id=1646528764364ebfbddf2a4653f8a3fc,sentry-release=Unknown"},"correlation_id":"01KWVH6EKFCD8DQHS6JGS5MPJF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:16.012Z","job_size_bytes":23,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-419b34ff5828001db7e09582: start","job_status":"start","queue_duration_s":1.138686,"scheduling_latency_s":1.138864}1839gitlab # [ 203.342468] nixbot[3143]: {"ts": "2026-07-06T10:57:17.211Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1840gitlab # [ 203.368188] nixbot[3143]: {"ts": "2026-07-06T10:57:17.237Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1841gitlab # [ 203.372638] gitaly[1386]: time="2026-07-06T10:57:17.241Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-06T10:57:47.133" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:17.234" grpc.time_ms=6.918 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1842gitlab # [ 203.384270] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:17.253Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"419b34ff5828001db7e09582","created_at":"2026-07-06T10:57:16.010Z","trace_propagation_headers":{"sentry-trace":"1646528764364ebfbddf2a4653f8a3fc-0a436e79c8a74d06","baggage":"sentry-trace_id=1646528764364ebfbddf2a4653f8a3fc,sentry-release=Unknown"},"correlation_id":"01KWVH6EKFCD8DQHS6JGS5MPJF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:16.012Z","job_size_bytes":23,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-419b34ff5828001db7e09582: done: 0.102562 sec","job_status":"done","queue_duration_s":1.138686,"scheduling_latency_s":1.138864,"gitaly_calls":1,"gitaly_duration_s":0.01056,"redis_calls":16,"redis_duration_s":0.007408,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000421,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.003604,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001312,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.102562,"completed_at":"2026-07-06T10:57:17.253Z","load_balancing_strategy":"primary","db_duration_s":0.004546,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1843gitlab # [ 203.460496] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:17.256Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b6dbd8936854e435dca84b2d","created_at":"2026-07-06T10:57:16.525Z","trace_propagation_headers":{"sentry-trace":"1646528764364ebfbddf2a4653f8a3fc-0a436e79c8a74d06","baggage":"sentry-trace_id=1646528764364ebfbddf2a4653f8a3fc,sentry-release=Unknown"},"correlation_id":"01KWVH6EKFCD8DQHS6JGS5MPJF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7c026045f05c46653f749c9f3c2e821daa4c6baf93beb3d772185f4dde9d6f19","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:16.530Z","job_size_bytes":467,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b6dbd8936854e435dca84b2d: start","job_status":"start","queue_duration_s":0.725612,"scheduling_latency_s":0.725647}1844gitlab # [ 203.462153] gitaly[1386]: time="2026-07-06T10:57:17.298Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:47.196" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:17.297" grpc.time_ms=0.925 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1845gitlab # [ 203.463090] nixbot[3143]: {"ts": "2026-07-06T10:57:17.260Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1846gitlab # [ 203.463811] nixbot[3143]: {"ts": "2026-07-06T10:57:17.263Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1847gitlab # [ 203.464950] nixbot[3143]: {"ts": "2026-07-06T10:57:17.268Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1848gitlab # [ 203.466084] nixbot[3143]: {"ts": "2026-07-06T10:57:17.273Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1849gitlab # [ 203.466981] nixbot[3143]: {"ts": "2026-07-06T10:57:17.277Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1850gitlab # [ 203.468039] nixbot[3143]: {"ts": "2026-07-06T10:57:17.279Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1851gitlab # [ 203.468819] nixbot[3143]: {"ts": "2026-07-06T10:57:17.284Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1852gitlab # [ 203.469960] nixbot[3143]: {"ts": "2026-07-06T10:57:17.286Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1853gitlab # [ 203.471408] nixbot[3143]: {"ts": "2026-07-06T10:57:17.291Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1854gitlab # [ 203.472202] nixbot[3143]: {"ts": "2026-07-06T10:57:17.296Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1855gitlab # [ 203.474162] nixbot[3143]: {"ts": "2026-07-06T10:57:17.300Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1856gitlab # [ 203.477265] nixbot[3143]: {"ts": "2026-07-06T10:57:17.302Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1857gitlab # [ 203.481301] gitaly[1386]: time="2026-07-06T10:57:17.309Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-06T10:57:27.290" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:17.301" grpc.time_ms=7.23 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1858gitlab # [ 203.552460] nixbot[3143]: {"ts": "2026-07-06T10:57:17.306Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1859gitlab # [ 203.553791] nixbot[3143]: {"ts": "2026-07-06T10:57:17.309Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1860gitlab # [ 203.554909] nixbot[3143]: {"ts": "2026-07-06T10:57:17.312Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1861gitlab # [ 203.556069] nixbot[3143]: {"ts": "2026-07-06T10:57:17.314Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1862gitlab # [ 203.556858] nixbot[3143]: {"ts": "2026-07-06T10:57:17.318Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1863gitlab # [ 203.558099] nixbot[3143]: {"ts": "2026-07-06T10:57:17.320Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1864gitlab # [ 203.558873] nixbot[3143]: {"ts": "2026-07-06T10:57:17.322Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1865gitlab # [ 203.560135] gitaly[1386]: time="2026-07-06T10:57:17.421Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-06T10:57:47.319" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:17.419" grpc.time_ms=1.001 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1866gitlab # [ 203.560918] gitaly[1386]: time="2026-07-06T10:57:17.427Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=59 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-06T10:57:47.324" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:17.425" grpc.time_ms=2.272 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1867gitlab # [ 203.648337] gitaly[1386]: time="2026-07-06T10:57:17.518Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:57:27.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:17.510" grpc.time_ms=7.138 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1868gitlab # [ 203.955404] nixbot[3143]: INFO: Started server process [3143]1869gitlab # [ 203.956700] nixbot[3143]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1870gitlab # [ 203.967481] nixbot[3143]: INFO: ::ffff:127.0.0.1:36840 - "GET /health HTTP/1.1" 200 OK1871gitlab # [ 203.977346] systemd[1]: Started nixbot CI service.1872gitlab # [ 203.982817] systemd[1]: Reached target Multi-User System.1873gitlab # [ 203.985783] systemd[1]: Startup finished in 1.584s (kernel) + 4.357s (initrd) + 3min 18.043s (userspace) = 3min 23.985s.1874gitlab # [ 204.355141] gitaly[1386]: time="2026-07-06T10:57:18.224Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=972 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-06T10:57:48.105" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:18.206" grpc.time_ms=18.381 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1875gitlab # [ 204.398155] gitaly[1386]: time="2026-07-06T10:57:18.267Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=957 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6HGCNZBEBYQ3NBFPZEA3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-06T10:57:48.055" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:18.256" grpc.time_ms=11.436 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876gitlab # [ 204.421977] gitaly[1386]: time="2026-07-06T10:57:18.291Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6EKFCD8DQHS6JGS5MPJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-06T10:57:48.151" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:18.251" grpc.time_ms=40.136 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877gitlab # [ 204.460532] sidekiq-cluster[2138]: {"severity":"WARN","time":"2026-07-06T10:57:18.329Z","class":"CreatePipelineWorker","correlation_id":"01KWVH6EKFCD8DQHS6JGS5MPJF","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"14bed34b441f0f8265254b37fea84aefed9c08c4","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"14bed34b441f0f8265254b37fea84aefed9c08c4","ref":"refs/heads/master"},"retry":0}1878gitlab # [ 204.472426] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:18.336Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b6dbd8936854e435dca84b2d","created_at":"2026-07-06T10:57:16.525Z","trace_propagation_headers":{"sentry-trace":"1646528764364ebfbddf2a4653f8a3fc-0a436e79c8a74d06","baggage":"sentry-trace_id=1646528764364ebfbddf2a4653f8a3fc,sentry-release=Unknown"},"correlation_id":"01KWVH6EKFCD8DQHS6JGS5MPJF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7c026045f05c46653f749c9f3c2e821daa4c6baf93beb3d772185f4dde9d6f19","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:16.530Z","job_size_bytes":467,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b6dbd8936854e435dca84b2d: done: 1.080395 sec","job_status":"done","queue_duration_s":0.725612,"scheduling_latency_s":0.725647,"gitaly_calls":7,"gitaly_duration_s":0.211852,"redis_calls":53,"redis_duration_s":0.026141,"redis_read_bytes":171,"redis_write_bytes":4427,"redis_cache_calls":4,"redis_cache_duration_s":0.002239,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.008294,"redis_feature_flag_read_bytes":18,"redis_feature_flag_write_bytes":2433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002291,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.011568,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001749,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":40,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":40,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.75692,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000502299,"duration_s":1.080395,"completed_at":"2026-07-06T10:57:18.336Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.065595,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1879gitlab # [ 204.508665] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:18.339Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"34b036219e2bac7b5abee775","created_at":"2026-07-06T10:57:16.881Z","trace_propagation_headers":{"sentry-trace":"1646528764364ebfbddf2a4653f8a3fc-b29f965016d243cd","baggage":"sentry-trace_id=1646528764364ebfbddf2a4653f8a3fc,sentry-release=Unknown"},"correlation_id":"01KWVH6EKFCD8DQHS6JGS5MPJF","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:16.885Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-34b036219e2bac7b5abee775: start","job_status":"start","queue_duration_s":1.453523,"scheduling_latency_s":1.453546}1880gitlab # [ 204.589630] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:18.458Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"34b036219e2bac7b5abee775","created_at":"2026-07-06T10:57:16.881Z","trace_propagation_headers":{"sentry-trace":"1646528764364ebfbddf2a4653f8a3fc-b29f965016d243cd","baggage":"sentry-trace_id=1646528764364ebfbddf2a4653f8a3fc,sentry-release=Unknown"},"correlation_id":"01KWVH6EKFCD8DQHS6JGS5MPJF","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:16.885Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-34b036219e2bac7b5abee775: done: 0.119475 sec","job_status":"done","queue_duration_s":1.453523,"scheduling_latency_s":1.453546,"redis_calls":19,"redis_duration_s":0.071451,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001614,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.06489,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003616,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001331,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07552663800000001,"duration_s":0.119475,"completed_at":"2026-07-06T10:57:18.458Z","load_balancing_strategy":"primary","db_duration_s":0.010099,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1881gitlab # [ 204.660258] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:18.529Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"5436d6a5f894a91e4b38825f","created_at":"2026-07-06T10:57:18.370Z","trace_propagation_headers":{"sentry-trace":"1646528764364ebfbddf2a4653f8a3fc-c45060a021924f03","baggage":"sentry-trace_id=1646528764364ebfbddf2a4653f8a3fc,sentry-release=Unknown"},"correlation_id":"01KWVH6EKFCD8DQHS6JGS5MPJF","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:18.376Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-5436d6a5f894a91e4b38825f: start","job_status":"start","queue_duration_s":0.152991,"scheduling_latency_s":0.153034}1882gitlab # [ 204.815154] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:18.684Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"5436d6a5f894a91e4b38825f","created_at":"2026-07-06T10:57:18.370Z","trace_propagation_headers":{"sentry-trace":"1646528764364ebfbddf2a4653f8a3fc-c45060a021924f03","baggage":"sentry-trace_id=1646528764364ebfbddf2a4653f8a3fc,sentry-release=Unknown"},"correlation_id":"01KWVH6EKFCD8DQHS6JGS5MPJF","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:18.376Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-5436d6a5f894a91e4b38825f: done: 0.155224 sec","job_status":"done","queue_duration_s":0.152991,"scheduling_latency_s":0.153034,"redis_calls":11,"redis_duration_s":0.005013,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002716,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000406477,"duration_s":0.155224,"completed_at":"2026-07-06T10:57:18.684Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030801,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1883gitlab # [ 204.907206] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:18 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 9391884gitlab # [ 204.912260] nixbot[3143]: {"ts": "2026-07-06T10:57:18.781Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1885gitlab: (finished: waiting for unit nixbot.service, in 2.18 seconds)1886gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1887gitlab # [ 204.931947] nixbot[3143]: {"ts": "2026-07-06T10:57:18.801Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1888gitlab # [ 204.954938] nixbot[3143]: INFO: ::ffff:127.0.0.1:58636 - "GET /health HTTP/1.1" 200 OK1889gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1890subtest: project discovered and webhook registered1891gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1892gitlab # [ 205.000924] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 581893gitlab # [ 205.001802] nixbot[3143]: {"ts": "2026-07-06T10:57:18.871Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1894gitlab # [ 205.003268] nixbot[3143]: {"ts": "2026-07-06T10:57:18.873Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1895gitlab # [ 205.053414] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.20.0" 671896gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds)1897gitlab # [ 205.105334] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 868 "" "python-httpx/0.28.1" 991898gitlab # [ 205.107491] nixbot[3143]: {"ts": "2026-07-06T10:57:18.977Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1899gitlab # [ 205.361925] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:19 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 2391900gitlab # [ 205.363819] nixbot[3143]: {"ts": "2026-07-06T10:57:19.233Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1901gitlab # [ 205.439482] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "python-httpx/0.28.1" 591902gitlab # [ 205.440857] nixbot[3143]: {"ts": "2026-07-06T10:57:19.310Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1903gitlab # [ 205.550062] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:19 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 868 "" "python-httpx/0.28.1" 931904gitlab # [ 205.559682] nixbot[3143]: {"ts": "2026-07-06T10:57:19.429Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1905gitlab # [ 205.636464] gitaly[1386]: time="2026-07-06T10:57:19.505Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6K2S69GMYMMZBYAHZTF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-07-06T10:57:49.388" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:19.489" grpc.time_ms=15.511 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1906gitlab # [ 205.686252] gitaly[1386]: time="2026-07-06T10:57:19.556Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6K2S69GMYMMZBYAHZTF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:49.454" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:19.554" grpc.time_ms=1.135 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1907gitlab # [ 205.710901] gitaly[1386]: time="2026-07-06T10:57:19.580Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6K2S69GMYMMZBYAHZTF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-06T10:57:29.142" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:19.563" grpc.time_ms=17.03 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1908gitlab # [ 205.783708] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 731 "" "python-httpx/0.28.1" 2031909gitlab # [ 205.785917] nixbot[3143]: {"ts": "2026-07-06T10:57:19.654Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1910gitlab # [ 205.869240] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 801911gitlab # [ 205.870649] nixbot[3143]: {"ts": "2026-07-06T10:57:19.739Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1912gitlab # [ 205.875220] nixbot[3143]: {"ts": "2026-07-06T10:57:19.744Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1913gitlab # [ 205.997276] gitaly[1386]: time="2026-07-06T10:57:19.866Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6KDBBYP6Y5963JRAS0NE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:19.853" grpc.time_ms=12.779 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc1914gitlab # [ 206.043865] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 1241915gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1916gitlab # [ 206.144652] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "curl/8.20.0" 521917gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.09 seconds)1918(finished: subtest: project discovered and webhook registered, in 1.19 seconds)1919subtest: push delivers the webhook1920gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1921gitlab # [ 206.167756] gitaly[1386]: time="2026-07-06T10:57:20.037Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6KHED5RHTZXK72A8SQER grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.030" pid=1386 remote_ip="2001:db8:1::1" request_sha=083c43590fffa527704b32b8836424e8ed055017 response_bytes=149 span.kind=server system=grpc1922gitlab # [ 206.170619] gitaly[1386]: time="2026-07-06T10:57:20.040Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6KHED5RHTZXK72A8SQER grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.030" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc1923gitlab # [ 206.172468] gitaly[1386]: time="2026-07-06T10:57:20.040Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6KHED5RHTZXK72A8SQER grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.030" grpc.time_ms=10.276 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc1924gitlab # [ 206.173431] gitlab-workhorse[1287]: time="2026-07-06T10:57:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1491925gitlab # [ 206.174223] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.54.0" 1231926gitlab # [ 206.238516] gitaly[1386]: time="2026-07-06T10:57:20.108Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6KNDMFCZMZNCJ30R3DD5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.092" pid=1386 remote_ip="2001:db8:1::1" request_sha=2def425c73889266fb9d5aa39136b77ebca39414 response_bytes=228 span.kind=server system=grpc1927gitlab # [ 206.239452] gitaly[1386]: time="2026-07-06T10:57:20.108Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6KNDMFCZMZNCJ30R3DD5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.092" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc1928gitlab # [ 206.240276] gitaly[1386]: time="2026-07-06T10:57:20.109Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6KNDMFCZMZNCJ30R3DD5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.092" grpc.time_ms=15.877 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc1929gitlab # [ 206.241166] gitlab-workhorse[1287]: time="2026-07-06T10:57:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2281930gitlab # [ 206.241895] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 228 "" "git/2.54.0" 641931gitlab # [ 206.374937] gitaly[1386]: time="2026-07-06T10:57:20.243Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6KT3WX66TG66BB3A5FHR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.234" grpc.time_ms=8.494 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc1932gitlab # [ 206.375630] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 481933gitlab # [ 206.428779] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:20 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 1121934gitlab # [ 206.476778] gitaly[1386]: time="2026-07-06T10:57:20.346Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6KVQD57H8ZN0C2HPR311 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.328" pid=1386 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1935gitlab # [ 206.477406] gitaly[1386]: time="2026-07-06T10:57:20.346Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6KVQD57H8ZN0C2HPR311 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.328" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc1936gitlab # [ 206.478745] gitaly[1386]: time="2026-07-06T10:57:20.348Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6KVQD57H8ZN0C2HPR311 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.328" grpc.time_ms=19.71 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc1937gitlab # [ 206.479903] gitlab-workhorse[1287]: time="2026-07-06T10:57:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671938gitlab # [ 206.481153] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 1011939gitlab # [ 206.620550] gitaly[1386]: time="2026-07-06T10:57:20.490Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M1PQHDJQAB2KFDKWATX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.482" grpc.time_ms=8.201 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc1940gitlab # [ 206.625181] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 551941gitlab # [ 206.645479] gitaly[1386]: time="2026-07-06T10:57:20.515Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=32 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6KXCMVE3MY3VA80063GC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.481" grpc.time_ms=33.508 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1942gitlab # [ 206.648099] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:20 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.54.0" 2151943gitlab # Enumerating objects: 5, done.1944gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1945gitlab # Delta compression using up to 4 threads1946gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1947gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1948gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1949gitlab # [ 206.699746] gitaly[1386]: time="2026-07-06T10:57:20.569Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M3GJKZG05KBKHMRPB92 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.543" pid=1386 remote_ip="2001:db8:1::1" request_sha=69dcef142412daaffeeda28f6446e517599d516e response_bytes=214 span.kind=server system=grpc1950gitlab # [ 206.700865] gitaly[1386]: time="2026-07-06T10:57:20.569Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1161 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M3GJKZG05KBKHMRPB92 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.543" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc1951gitlab # [ 206.739115] gitaly[1386]: time="2026-07-06T10:57:20.607Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1161 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=5 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M3GJKZG05KBKHMRPB92 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.543" grpc.time_ms=63.798 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc1952gitlab # [ 206.739920] gitlab-workhorse[1287]: time="2026-07-06T10:57:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2141953gitlab # [ 206.740960] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 214 "" "git/2.54.0" 1121954gitlab # [ 206.863136] gitaly[1386]: time="2026-07-06T10:57:20.732Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M95M791QAAMAFBCNQ1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:50.631" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:20.731" grpc.time_ms=1.16 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1955gitlab # [ 206.900647] gitaly[1386]: time="2026-07-06T10:57:20.770Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-06T10:57:30.001" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:20.761" grpc.time_ms=8.37 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1956gitlab # [ 206.932610] gitaly[1386]: time="2026-07-06T10:57:20.802Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M95M791QAAMAFBCNQ1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-07-06T10:57:50.694" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:20.794" grpc.time_ms=7.85 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1957gitlab # [ 206.960101] gitaly[1386]: time="2026-07-06T10:57:20.829Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=12 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-06T10:57:50.612" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-06T10:57:20.813" grpc.time_ms=16.329 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 206.982662] gitaly[1386]: time="2026-07-06T10:57:20.848Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=9 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M95M791QAAMAFBCNQ1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:57:30.135" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:20.835" grpc.time_ms=12.004 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1959gitlab # [ 207.005637] gitaly[1386]: time="2026-07-06T10:57:20.859Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 duration_ms=172ns method=POST pid=1386 status=200 url="http://unix/api/v4/internal/allowed"1960gitlab # [ 207.029828] gitaly[1386]: time="2026-07-06T10:57:20.899Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M95M791QAAMAFBCNQ1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-06T10:57:30.198" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:20.899" grpc.time_ms=0.24 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1961gitlab # [ 207.047199] gitaly[1386]: time="2026-07-06T10:57:20.916Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M95M791QAAMAFBCNQ1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-06T10:57:30.206" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:20.907" grpc.time_ms=8.991 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962gitlab # [ 207.095696] gitaly[1386]: time="2026-07-06T10:57:20.965Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M95M791QAAMAFBCNQ1E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4157 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:20.964" grpc.time_ms=0.478 pid=1386 span.kind=server system=grpc1963gitlab # [ 207.137674] gitaly[1386]: time="2026-07-06T10:57:21.007Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M95M791QAAMAFBCNQ1E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4159 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:21.004" grpc.time_ms=1.276 pid=1386 span.kind=server system=grpc1964gitlab # [ 207.153618] gitaly[1386]: time="2026-07-06T10:57:21.023Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 duration_ms=163ns method=POST pid=1386 status=200 url="http://unix/api/v4/internal/pre_receive"1965gitlab # [ 207.154441] gitaly[1386]: time="2026-07-06T10:57:21.023Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5319 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:20.686" grpc.time_ms=337.492 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1966gitlab # [ 207.185203] gitaly[1386]: time="2026-07-06T10:57:21.055Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M95M791QAAMAFBCNQ1E diskcache=04760d4c-2faa-4954-84ab-ab98d21d22b0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-06T10:57:30.220" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:20.921" pid=1386 ref=refs/keep-around/14bed34b441f0f8265254b37fea84aefed9c08c4 remote_ip="2001:db8:1::1" revision=14bed34b441f0f8265254b37fea84aefed9c08c4 span.kind=server system=grpc username=root1967gitlab # [ 207.185746] gitaly[1386]: time="2026-07-06T10:57:21.055Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=88 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5271 command.oublock=8 command.real_time_ms=123 command.spawn_token_fork_ms=3 command.system_time_ms=63 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M95M791QAAMAFBCNQ1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-06T10:57:30.220" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:20.921" grpc.time_ms=134.125 pid=1386 ref=refs/keep-around/14bed34b441f0f8265254b37fea84aefed9c08c4 remote_ip="2001:db8:1::1" revision=14bed34b441f0f8265254b37fea84aefed9c08c4 span.kind=server system=grpc username=root1968gitlab # [ 207.203583] gitaly[1386]: time="2026-07-06T10:57:21.073Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4789 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:21.071" grpc.time_ms=2.155 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1969gitlab # [ 207.205696] gitaly[1386]: time="2026-07-06T10:57:21.075Z" level=info msg="finished unary call with code OK" catfile.duration_ms=14 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=14 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M95M791QAAMAFBCNQ1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:51.059" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:21.059" grpc.time_ms=15.569 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1970gitlab # [ 207.224632] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:21.091Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"fc9953a7b7be2ab03c356135","created_at":"2026-07-06T10:57:21.079Z","trace_propagation_headers":{"sentry-trace":"1e5578e1c48c42bdb2c880b560f97c37-bb3d53d1fc254b32","baggage":"sentry-trace_id=1e5578e1c48c42bdb2c880b560f97c37,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6M95M791QAAMAFBCNQ1E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.088Z","job_size_bytes":65,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-fc9953a7b7be2ab03c356135: start","job_status":"start","queue_duration_s":0.003491,"scheduling_latency_s":0.003542}1971gitlab # [ 207.274994] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:21.144Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"fc9953a7b7be2ab03c356135","created_at":"2026-07-06T10:57:21.079Z","trace_propagation_headers":{"sentry-trace":"1e5578e1c48c42bdb2c880b560f97c37-bb3d53d1fc254b32","baggage":"sentry-trace_id=1e5578e1c48c42bdb2c880b560f97c37,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6M95M791QAAMAFBCNQ1E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.088Z","job_size_bytes":65,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-fc9953a7b7be2ab03c356135: done: 0.052956 sec","job_status":"done","queue_duration_s":0.003491,"scheduling_latency_s":0.003542,"redis_calls":19,"redis_duration_s":0.004814000000000001,"redis_read_bytes":145,"redis_write_bytes":2300,"redis_feature_flag_calls":11,"redis_feature_flag_duration_s":0.002743,"redis_feature_flag_read_bytes":138,"redis_feature_flag_write_bytes":1482,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001561,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00051,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000375188,"duration_s":0.052956,"completed_at":"2026-07-06T10:57:21.144Z","load_balancing_strategy":"primary","db_duration_s":0.010354,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1972gitlab # [ 207.287899] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:21.149Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2c0ef3d11b5ccbd6f80b80bd","created_at":"2026-07-06T10:57:21.088Z","trace_propagation_headers":{"sentry-trace":"1e5578e1c48c42bdb2c880b560f97c37-bb3d53d1fc254b32","baggage":"sentry-trace_id=1e5578e1c48c42bdb2c880b560f97c37,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6M95M791QAAMAFBCNQ1E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.095Z","job_size_bytes":65,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2c0ef3d11b5ccbd6f80b80bd: start","job_status":"start","queue_duration_s":0.05428,"scheduling_latency_s":0.054304}1973gitlab # [ 207.368572] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/14bed34b441f0f8265254b37fea84aefed9c08c4 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5321974gitlab # [ 207.391587] nixbot[3143]: {"ts": "2026-07-06T10:57:21.259Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/14bed34b441f0f8265254b37fea84aefed9c08c4 \"HTTP/1.1 201 Created\""}1975gitlab # [ 207.400761] nixbot[3143]: {"ts": "2026-07-06T10:57:21.270Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-14bed34b441f-14e620a8", "argv0": "bwrap"}1976gitlab # [ 207.411675] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:21.281Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2c0ef3d11b5ccbd6f80b80bd","created_at":"2026-07-06T10:57:21.088Z","trace_propagation_headers":{"sentry-trace":"1e5578e1c48c42bdb2c880b560f97c37-bb3d53d1fc254b32","baggage":"sentry-trace_id=1e5578e1c48c42bdb2c880b560f97c37,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6M95M791QAAMAFBCNQ1E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.095Z","job_size_bytes":65,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2c0ef3d11b5ccbd6f80b80bd: done: 0.131607 sec","job_status":"done","queue_duration_s":0.05428,"scheduling_latency_s":0.054304,"redis_calls":15,"redis_duration_s":0.012329,"redis_read_bytes":142,"redis_write_bytes":1431,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00504,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":431,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005357,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001932,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000402286,"duration_s":0.131607,"completed_at":"2026-07-06T10:57:21.281Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010824,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1977gitlab # [ 207.413966] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:21.282Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"652979f10962dd4248320622","created_at":"2026-07-06T10:57:21.190Z","trace_propagation_headers":{"sentry-trace":"1e5578e1c48c42bdb2c880b560f97c37-bb3d53d1fc254b32","baggage":"sentry-trace_id=1e5578e1c48c42bdb2c880b560f97c37,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6M95M791QAAMAFBCNQ1E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.196Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-652979f10962dd4248320622: start","job_status":"start","queue_duration_s":0.086522,"scheduling_latency_s":0.086546}1978gitlab # [ 207.542639] gitaly[1386]: time="2026-07-06T10:57:21.412Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4788 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:21.411" grpc.time_ms=0.453 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1979gitlab # [ 207.586110] gitaly[1386]: time="2026-07-06T10:57:21.455Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M95M791QAAMAFBCNQ1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-06T10:57:51.353" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:21.454" grpc.time_ms=0.774 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 207.607656] systemd[1]: Started Nix Daemon.1981gitlab # [ 207.611095] gitaly[1386]: time="2026-07-06T10:57:21.480Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4790 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:21.480" grpc.time_ms=0.417 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1982gitlab # [ 207.626829] gitaly[1386]: time="2026-07-06T10:57:21.496Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M95M791QAAMAFBCNQ1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:51.395" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:21.496" grpc.time_ms=0.681 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1983gitlab # [ 207.657186] nix-daemon[3387]: accepted connection from pid 3376, user nixbot1984gitlab # [ 207.659289] gitaly[1386]: time="2026-07-06T10:57:21.527Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M95M791QAAMAFBCNQ1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:51.424" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:21.526" grpc.time_ms=0.553 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1985gitlab # [ 207.666336] nix-daemon[3387]: accepted connection from pid 3375, user nixbot1986gitlab # [ 207.671440] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:21.541Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"652979f10962dd4248320622","created_at":"2026-07-06T10:57:21.190Z","trace_propagation_headers":{"sentry-trace":"1e5578e1c48c42bdb2c880b560f97c37-bb3d53d1fc254b32","baggage":"sentry-trace_id=1e5578e1c48c42bdb2c880b560f97c37,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6M95M791QAAMAFBCNQ1E","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.196Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-652979f10962dd4248320622: done: 0.25826 sec","job_status":"done","queue_duration_s":0.086522,"scheduling_latency_s":0.086546,"gitaly_calls":3,"gitaly_duration_s":0.012772,"redis_calls":48,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.022539,"redis_read_bytes":208,"redis_write_bytes":6803,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002515,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":16,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001783,"redis_cache_read_bytes":32,"redis_cache_write_bytes":1470,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.001905,"redis_feature_flag_read_bytes":134,"redis_feature_flag_write_bytes":992,"redis_queues_calls":2,"redis_queues_duration_s":0.000349,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001964,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":840,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.008565,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000311,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002632,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":22,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.178045,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.150042533,"duration_s":0.25826,"completed_at":"2026-07-06T10:57:21.541Z","load_balancing_strategy":"primary","db_duration_s":0.039032,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1987gitlab # [ 207.697375] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:21.544Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"539b056abd0e654b1faf363d","created_at":"2026-07-06T10:57:21.436Z","trace_propagation_headers":{"sentry-trace":"1e5578e1c48c42bdb2c880b560f97c37-b52bb10898cf4920","baggage":"sentry-trace_id=1e5578e1c48c42bdb2c880b560f97c37,sentry-release=Unknown"},"correlation_id":"01KWVH6M95M791QAAMAFBCNQ1E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.441Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-539b056abd0e654b1faf363d: start","job_status":"start","queue_duration_s":0.102773,"scheduling_latency_s":0.102797}1988gitlab # [ 207.721438] gitaly[1386]: time="2026-07-06T10:57:21.583Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 duration_ms=68ns method=POST pid=1386 status=200 url="http://unix/api/v4/internal/post_receive"1989gitlab # [ 207.726588] gitaly[1386]: time="2026-07-06T10:57:21.584Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4813 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:21.515" grpc.time_ms=69.048 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1990gitlab # [ 207.744789] gitaly[1386]: time="2026-07-06T10:57:21.603Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 diskcache=c4e2387d-9e3f-4989-9bac-49924d9076d4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.621" pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1991gitlab # [ 207.812632] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:21.605Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"539b056abd0e654b1faf363d","created_at":"2026-07-06T10:57:21.436Z","trace_propagation_headers":{"sentry-trace":"1e5578e1c48c42bdb2c880b560f97c37-b52bb10898cf4920","baggage":"sentry-trace_id=1e5578e1c48c42bdb2c880b560f97c37,sentry-release=Unknown"},"correlation_id":"01KWVH6M95M791QAAMAFBCNQ1E","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.441Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-539b056abd0e654b1faf363d: done: 0.061163 sec","job_status":"done","queue_duration_s":0.102773,"scheduling_latency_s":0.102797,"redis_calls":10,"redis_duration_s":0.009783,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00185,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006104,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001829,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000830553,"duration_s":0.061163,"completed_at":"2026-07-06T10:57:21.605Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014523,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1992gitlab # [ 207.825218] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:21.609Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","14bed34b441f0f8265254b37fea84aefed9c08c4 af25ac6396f2347124180d83988a5c4d127575f7 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"37e380376d469424579aa9bb","created_at":"2026-07-06T10:57:21.562Z","trace_propagation_headers":{"sentry-trace":"bd627b2a239248a0be28a41601b330cd-643c1e3c57894b63","baggage":"sentry-trace_id=bd627b2a239248a0be28a41601b330cd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6M5ERSVPAXBFZXZC1P04","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.565Z","job_size_bytes":185,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-37e380376d469424579aa9bb: start","job_status":"start","queue_duration_s":0.043773,"scheduling_latency_s":0.043796}1993gitlab # [ 207.850123] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:21.621Z","message":"changes: \"14bed34b441f0f8265254b37fea84aefed9c08c4 af25ac6396f2347124180d83988a5c4d127575f7 refs/heads/master\\n\""}1994gitlab # [ 207.853943] gitlab-workhorse[1287]: time="2026-07-06T10:57:21Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521995gitlab # [ 207.921786] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:21 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 10451996gitlab # [ 207.922458] gitaly[1386]: time="2026-07-06T10:57:21.603Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=285 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13208 command.oublock=32 command.real_time_ms=969 command.spawn_token_fork_ms=1 command.system_time_ms=192 command.user_time_ms=93 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:20.621" grpc.time_ms=981.682 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1997gitlab # [ 207.923815] gitaly[1386]: time="2026-07-06T10:57:21.644Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=619 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:57:31.135" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:21.635" grpc.time_ms=7.914 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1998gitlab # [ 207.924830] gitaly[1386]: time="2026-07-06T10:57:21.653Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-06T10:57:31.147" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:21.647" grpc.time_ms=5.613 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999gitlab # [ 207.925717] gitaly[1386]: time="2026-07-06T10:57:21.672Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-06T10:57:31.166" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:21.666" grpc.time_ms=5.766 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab # [ 207.991809] gitaly[1386]: time="2026-07-06T10:57:21.682Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-07-06T10:57:51.574" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:21.675" grpc.time_ms=7.421 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001gitlab # [ 207.993164] gitaly[1386]: time="2026-07-06T10:57:21.701Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-06T10:57:31.197" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-07-06T10:57:21.697" grpc.time_ms=3.52 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2002gitlab # [ 207.993955] gitaly[1386]: time="2026-07-06T10:57:21.717Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:57:31.211" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:21.711" grpc.time_ms=5.466 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2003gitlab # [ 208.055641] gitaly[1386]: time="2026-07-06T10:57:21.925Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=61 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=61 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-06T10:57:31.001" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:21.862" grpc.time_ms=63.14 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2004gitlab # [ 208.078909] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:21.948Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","14bed34b441f0f8265254b37fea84aefed9c08c4 af25ac6396f2347124180d83988a5c4d127575f7 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"37e380376d469424579aa9bb","created_at":"2026-07-06T10:57:21.562Z","trace_propagation_headers":{"sentry-trace":"bd627b2a239248a0be28a41601b330cd-643c1e3c57894b63","baggage":"sentry-trace_id=bd627b2a239248a0be28a41601b330cd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6M5ERSVPAXBFZXZC1P04","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.565Z","job_size_bytes":185,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-37e380376d469424579aa9bb: done: 0.339036 sec","job_status":"done","queue_duration_s":0.043773,"scheduling_latency_s":0.043796,"gitaly_calls":7,"gitaly_duration_s":0.119292,"redis_calls":112,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.02359,"redis_read_bytes":350,"redis_write_bytes":13069,"redis_cache_calls":9,"redis_cache_duration_s":0.002548,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00046,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":323,"redis_queues_calls":8,"redis_queues_duration_s":0.001643,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6769,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.003483,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.008012,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.007444,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":29,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":29,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.018,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.018,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.175048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000546718,"exclusive_lock_hold_duration_s":0.017334606,"duration_s":0.339036,"completed_at":"2026-07-06T10:57:21.948Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025721,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2005gitlab # [ 208.166559] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:21.950Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"48d515067618f8789019ac66","created_at":"2026-07-06T10:57:21.655Z","trace_propagation_headers":{"sentry-trace":"bd627b2a239248a0be28a41601b330cd-9db779b7b5b545c8","baggage":"sentry-trace_id=bd627b2a239248a0be28a41601b330cd,sentry-release=Unknown"},"correlation_id":"01KWVH6M5ERSVPAXBFZXZC1P04","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.657Z","job_size_bytes":46,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-48d515067618f8789019ac66: start","job_status":"start","queue_duration_s":0.293004,"scheduling_latency_s":0.293039}2006gitlab # [ 208.167672] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:21.969Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"48d515067618f8789019ac66","created_at":"2026-07-06T10:57:21.655Z","trace_propagation_headers":{"sentry-trace":"bd627b2a239248a0be28a41601b330cd-9db779b7b5b545c8","baggage":"sentry-trace_id=bd627b2a239248a0be28a41601b330cd,sentry-release=Unknown"},"correlation_id":"01KWVH6M5ERSVPAXBFZXZC1P04","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.657Z","job_size_bytes":46,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-48d515067618f8789019ac66: done: 0.018956 sec","job_status":"done","queue_duration_s":0.293004,"scheduling_latency_s":0.293039,"redis_calls":9,"redis_duration_s":0.002104,"redis_read_bytes":23,"redis_write_bytes":782,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001198,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000234,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000672,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018956,"completed_at":"2026-07-06T10:57:21.968Z","load_balancing_strategy":"primary","db_duration_s":0.001719,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2007gitlab # [ 208.261711] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:21.970Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"bf2e289f85948fc68851cedc","created_at":"2026-07-06T10:57:21.661Z","trace_propagation_headers":{"sentry-trace":"bd627b2a239248a0be28a41601b330cd-9db779b7b5b545c8","baggage":"sentry-trace_id=bd627b2a239248a0be28a41601b330cd,sentry-release=Unknown"},"correlation_id":"01KWVH6M5ERSVPAXBFZXZC1P04","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.662Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-bf2e289f85948fc68851cedc: start","job_status":"start","queue_duration_s":0.308034,"scheduling_latency_s":0.308057}2008gitlab # [ 208.263228] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:22.108Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"bf2e289f85948fc68851cedc","created_at":"2026-07-06T10:57:21.661Z","trace_propagation_headers":{"sentry-trace":"bd627b2a239248a0be28a41601b330cd-9db779b7b5b545c8","baggage":"sentry-trace_id=bd627b2a239248a0be28a41601b330cd,sentry-release=Unknown"},"correlation_id":"01KWVH6M5ERSVPAXBFZXZC1P04","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.662Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-bf2e289f85948fc68851cedc: done: 0.138415 sec","job_status":"done","queue_duration_s":0.308034,"scheduling_latency_s":0.308057,"gitaly_calls":1,"gitaly_duration_s":0.107669,"redis_calls":12,"redis_duration_s":0.003593,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00062,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001562,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.119993463,"duration_s":0.138415,"completed_at":"2026-07-06T10:57:22.108Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004199,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2009gitlab # [ 208.353215] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:22.110Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f3227678257a89cd9a347a33","created_at":"2026-07-06T10:57:21.763Z","trace_propagation_headers":{"sentry-trace":"bd627b2a239248a0be28a41601b330cd-9db779b7b5b545c8","baggage":"sentry-trace_id=bd627b2a239248a0be28a41601b330cd,sentry-release=Unknown"},"correlation_id":"01KWVH6M5ERSVPAXBFZXZC1P04","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a1edba8110b0f566482a1cfe15edb9714b8dd8aae1f15cf67da69e56d8f24a23","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.765Z","job_size_bytes":467,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f3227678257a89cd9a347a33: start","job_status":"start","queue_duration_s":0.345509,"scheduling_latency_s":0.34554}2010gitlab # [ 208.354530] gitaly[1386]: time="2026-07-06T10:57:22.091Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 diskcache=50e55a67-a1f5-4419-a3e0-dec2b9188ca6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-06T16:57:21.985" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:21.986" pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011gitlab # [ 208.355789] gitaly[1386]: time="2026-07-06T10:57:22.091Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=5 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1641 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-06T16:57:21.985" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:21.986" grpc.time_ms=105.03 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2012gitlab # [ 208.356886] gitaly[1386]: time="2026-07-06T10:57:22.132Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:52.031" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:22.131" grpc.time_ms=0.828 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2013gitlab # [ 208.435429] gitaly[1386]: time="2026-07-06T10:57:22.141Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-06T10:57:32.003" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:22.134" grpc.time_ms=7.334 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2014gitlab # [ 208.436922] gitaly[1386]: time="2026-07-06T10:57:22.166Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-06T10:57:52.064" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:22.165" grpc.time_ms=0.829 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2015gitlab # [ 208.437983] gitaly[1386]: time="2026-07-06T10:57:22.171Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=201 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-06T10:57:52.068" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:22.169" grpc.time_ms=2.764 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2016gitlab # [ 208.439142] gitaly[1386]: time="2026-07-06T10:57:22.211Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:57:32.073" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:22.203" grpc.time_ms=7.026 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2017gitlab # To http://gitlab/root/test-flake.git2018gitlab # 14bed34..af25ac6 master -> master2019gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 2.41 seconds)2020gitlab: must succeed: git -C /tmp/test-flake rev-parse master2021gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)2022gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af25ac6396f2347124180d83988a5c4d127575f7'2023gitlab # [ 208.591181] nixbot[3143]: INFO: ::ffff:127.0.0.1:58650 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af25ac6396f2347124180d83988a5c4d127575f7 HTTP/1.1" 200 OK2024gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af25ac6396f2347124180d83988a5c4d127575f7', in 0.03 seconds)2025gitlab # [ 209.104619] gitaly[1386]: time="2026-07-06T10:57:22.973Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-06T10:57:52.850" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:22.951" grpc.time_ms=22.08 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2026gitlab # [ 209.177418] gitaly[1386]: time="2026-07-06T10:57:23.047Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6M5ERSVPAXBFZXZC1P04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-06T10:57:52.927" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:23.028" grpc.time_ms=18.652 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2027gitlab # [ 209.212388] sidekiq-cluster[2138]: {"severity":"WARN","time":"2026-07-06T10:57:23.082Z","class":"CreatePipelineWorker","correlation_id":"01KWVH6M5ERSVPAXBFZXZC1P04","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"14bed34b441f0f8265254b37fea84aefed9c08c4","after":"af25ac6396f2347124180d83988a5c4d127575f7","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"af25ac6396f2347124180d83988a5c4d127575f7","ref":"refs/heads/master"},"retry":0}2028gitlab # [ 209.228407] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:23.097Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f3227678257a89cd9a347a33","created_at":"2026-07-06T10:57:21.763Z","trace_propagation_headers":{"sentry-trace":"bd627b2a239248a0be28a41601b330cd-9db779b7b5b545c8","baggage":"sentry-trace_id=bd627b2a239248a0be28a41601b330cd,sentry-release=Unknown"},"correlation_id":"01KWVH6M5ERSVPAXBFZXZC1P04","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a1edba8110b0f566482a1cfe15edb9714b8dd8aae1f15cf67da69e56d8f24a23","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.765Z","job_size_bytes":467,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f3227678257a89cd9a347a33: done: 0.987332 sec","job_status":"done","queue_duration_s":0.345509,"scheduling_latency_s":0.34554,"gitaly_calls":7,"gitaly_duration_s":0.1485,"redis_calls":33,"redis_duration_s":0.016196,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000815,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011755,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002259,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001367,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":30,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.271,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":26,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.267,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.53819,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.987332,"completed_at":"2026-07-06T10:57:23.097Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.270779,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2029gitlab # [ 209.306232] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:23.173Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"cd854a0d-08e0-47c2-a651-5b8ae820c494\"}"],"class":"WebHookWorker","jid":"3a0d9ad3eea288d6932d9985","created_at":"2026-07-06T10:57:21.847Z","trace_propagation_headers":{"sentry-trace":"bd627b2a239248a0be28a41601b330cd-9db779b7b5b545c8","baggage":"sentry-trace_id=bd627b2a239248a0be28a41601b330cd,sentry-release=Unknown"},"correlation_id":"01KWVH6M5ERSVPAXBFZXZC1P04","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c43f171a3d021683bd0729a20909997d4b44ab0e7931b6939def0b9f90ba36b3","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.852Z","job_size_bytes":1749,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3a0d9ad3eea288d6932d9985: start","job_status":"start","queue_duration_s":1.321396,"scheduling_latency_s":1.321444}2030gitlab # [ 209.406400] nixbot[3143]: INFO: ::ffff:127.0.0.1:58662 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2031gitlab # [ 209.430886] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:23.299Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"cd854a0d-08e0-47c2-a651-5b8ae820c494\"}"],"class":"WebHookWorker","jid":"3a0d9ad3eea288d6932d9985","created_at":"2026-07-06T10:57:21.847Z","trace_propagation_headers":{"sentry-trace":"bd627b2a239248a0be28a41601b330cd-9db779b7b5b545c8","baggage":"sentry-trace_id=bd627b2a239248a0be28a41601b330cd,sentry-release=Unknown"},"correlation_id":"01KWVH6M5ERSVPAXBFZXZC1P04","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c43f171a3d021683bd0729a20909997d4b44ab0e7931b6939def0b9f90ba36b3","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:21.852Z","job_size_bytes":1749,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3a0d9ad3eea288d6932d9985: done: 0.125808 sec","job_status":"done","queue_duration_s":1.321396,"scheduling_latency_s":1.321444,"redis_calls":19,"redis_duration_s":0.008058,"redis_read_bytes":31,"redis_write_bytes":5282,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001733,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000705,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3644,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003651,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001969,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.011453969000001507,"cpu_s":0.084319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000628851,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","duration_s":0.125808,"completed_at":"2026-07-06T10:57:23.299Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004554,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2032gitlab # [ 209.445835] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:23.303Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3a0d9ad3eea288d6932d9985"],"class":"WebHooks::LogExecutionWorker","jid":"caa900a01136850a2fbcb3c0","created_at":"2026-07-06T10:57:23.278Z","trace_propagation_headers":{"sentry-trace":"bd627b2a239248a0be28a41601b330cd-1f8dd99aac3b479c","baggage":"sentry-trace_id=bd627b2a239248a0be28a41601b330cd,sentry-release=Unknown"},"correlation_id":"01KWVH6M5ERSVPAXBFZXZC1P04","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:71e9fcff62934ab79ee614694a4a52572080361a33a1fb59dbb340a0b04090de","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:23.284Z","job_size_bytes":2507,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-caa900a01136850a2fbcb3c0: start","job_status":"start","queue_duration_s":0.018923,"scheduling_latency_s":0.018986}2033gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af25ac6396f2347124180d83988a5c4d127575f7'2034gitlab # [ 209.597302] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:23.466Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3a0d9ad3eea288d6932d9985"],"class":"WebHooks::LogExecutionWorker","jid":"caa900a01136850a2fbcb3c0","created_at":"2026-07-06T10:57:23.278Z","trace_propagation_headers":{"sentry-trace":"bd627b2a239248a0be28a41601b330cd-1f8dd99aac3b479c","baggage":"sentry-trace_id=bd627b2a239248a0be28a41601b330cd,sentry-release=Unknown"},"correlation_id":"01KWVH6M5ERSVPAXBFZXZC1P04","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:71e9fcff62934ab79ee614694a4a52572080361a33a1fb59dbb340a0b04090de","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:23.284Z","job_size_bytes":2507,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-caa900a01136850a2fbcb3c0: done: 0.163327 sec","job_status":"done","queue_duration_s":0.018923,"scheduling_latency_s":0.018986,"redis_calls":10,"redis_duration_s":0.005033,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000706,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003675,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000652,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.029,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.029,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.112249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000799264,"duration_s":0.163327,"completed_at":"2026-07-06T10:57:23.466Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2035gitlab # [ 209.686104] nixbot[3143]: INFO: ::ffff:127.0.0.1:58668 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af25ac6396f2347124180d83988a5c4d127575f7 HTTP/1.1" 200 OK2036gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af25ac6396f2347124180d83988a5c4d127575f7', in 0.09 seconds)2037gitlab # [ 209.700163] gitaly[1386]: time="2026-07-06T10:57:23.569Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6PZ1JJTT3GA2MK8GJDG5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:23.561" grpc.time_ms=7.735 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc2038gitlab # [ 209.702486] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 1432039gitlab # [ 209.785182] gitaly[1386]: time="2026-07-06T10:57:23.654Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6Q4BAGB0BE401RMYMW8N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:23.644" pid=1386 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc2040gitlab # [ 209.801838] gitaly[1386]: time="2026-07-06T10:57:23.655Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6Q4BAGB0BE401RMYMW8N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:23.644" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc2041gitlab # [ 209.822706] gitaly[1386]: time="2026-07-06T10:57:23.656Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6Q4BAGB0BE401RMYMW8N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:23.644" grpc.time_ms=10.563 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc2042gitlab # [ 209.845982] gitlab-workhorse[1287]: time="2026-07-06T10:57:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672043gitlab # [ 209.849379] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 1192044gitlab # [ 209.916318] gitaly[1386]: time="2026-07-06T10:57:23.786Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6Q85F3BW0X3PMBMMG0Y1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:23.770" pid=1386 remote_ip="2001:db8:1::1" request_sha=db200b4cc2954076e7f84a1676908b3e3e750aa6 response_bytes=337 span.kind=server system=grpc2045gitlab # [ 209.932403] gitaly[1386]: time="2026-07-06T10:57:23.786Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1193 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6Q85F3BW0X3PMBMMG0Y1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:23.770" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc2046gitlab # [ 209.955185] gitlab-workhorse[1287]: time="2026-07-06T10:57:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3372047gitlab # [ 209.958444] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.54.0" 692048gitlab # [ 209.961741] gitaly[1386]: time="2026-07-06T10:57:23.786Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1193 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6Q85F3BW0X3PMBMMG0Y1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:23.770" grpc.time_ms=15.587 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc2049gitlab # [ 210.041394] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 532050gitlab # [ 210.045209] gitaly[1386]: time="2026-07-06T10:57:23.911Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6QCHNKJE714CVFS7T9EE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:23.901" grpc.time_ms=8.052 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc2051gitlab # [ 210.106846] gitaly[1386]: time="2026-07-06T10:57:23.976Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QE8Y55VAZPR5NR3ARR0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:23.961" pid=1386 remote_ip="2001:db8:1::1" request_sha=f1e6bb59289c4d43fc3699ed3fc4760ee01ef0e9 response_bytes=216 span.kind=server system=grpc2052gitlab # [ 210.123327] gitaly[1386]: time="2026-07-06T10:57:23.976Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1165 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QE8Y55VAZPR5NR3ARR0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:23.961" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc2053gitlab # [ 210.123882] gitlab-workhorse[1287]: time="2026-07-06T10:57:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162054gitlab # [ 210.124940] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.54.0" 652055gitlab # [ 210.126312] gitaly[1386]: time="2026-07-06T10:57:23.978Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1165 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QE8Y55VAZPR5NR3ARR0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:57:23.961" grpc.time_ms=15.342 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc2056gitlab # [ 210.156812] nixbot[3143]: {"ts": "2026-07-06T10:57:24.026Z", "level": "info", "logger": "nixbot.canceller", "msg": "cancelling build", "build_id": 1, "reason": "superseded"}2057gitlab # [ 210.163868] nix-daemon[3401]: unexpected Nix daemon error: error: interrupted by the user2058gitlab # [ 210.230062] gitaly[1386]: time="2026-07-06T10:57:24.099Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QJH5J0THV15YSWF0XN1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:54.098" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:24.099" grpc.time_ms=0.63 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab # [ 210.254058] gitaly[1386]: time="2026-07-06T10:57:24.123Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QK0K19639QGJN7TBRVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:54.022" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:24.123" grpc.time_ms=0.653 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2060gitlab # [ 210.254839] gitaly[1386]: time="2026-07-06T10:57:24.123Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6QJH5J0THV15YSWF0XN1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-07-06T10:57:54.006" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:24.107" grpc.time_ms=16.682 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2061gitlab # [ 210.311124] gitaly[1386]: time="2026-07-06T10:57:24.180Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6QJH5J0THV15YSWF0XN1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:57:34.130" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:24.171" grpc.time_ms=9.155 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2062gitlab # [ 210.333067] gitaly[1386]: time="2026-07-06T10:57:24.202Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QJH5J0THV15YSWF0XN1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-06T10:57:34.160" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:24.201" grpc.time_ms=1.092 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2063gitlab # [ 210.345753] gitaly[1386]: time="2026-07-06T10:57:24.215Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QJH5J0THV15YSWF0XN1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-06T10:57:34.167" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:24.208" grpc.time_ms=7.103 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2064gitlab # [ 210.379772] gitaly[1386]: time="2026-07-06T10:57:24.249Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6QK0K19639QGJN7TBRVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:57:34.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:24.240" grpc.time_ms=8.808 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2065gitlab # [ 210.385325] gitaly[1386]: time="2026-07-06T10:57:24.255Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6QJH5J0THV15YSWF0XN1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4157 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:24.254" grpc.time_ms=0.415 pid=1386 span.kind=server system=grpc2066gitlab # [ 210.441127] gitaly[1386]: time="2026-07-06T10:57:24.310Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6QJH5J0THV15YSWF0XN1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4159 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:24.309" grpc.time_ms=0.432 pid=1386 span.kind=server system=grpc2067gitlab # [ 210.466079] gitaly[1386]: time="2026-07-06T10:57:24.335Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QJH5J0THV15YSWF0XN1 diskcache=cd314f66-f729-4f70-b6ef-c3ccd3bf7dec grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-06T10:57:34.178" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:24.219" pid=1386 ref=refs/keep-around/af25ac6396f2347124180d83988a5c4d127575f7 remote_ip="2001:db8:1::1" revision=af25ac6396f2347124180d83988a5c4d127575f7 span.kind=server system=grpc username=root2068gitlab # [ 210.484228] gitaly[1386]: time="2026-07-06T10:57:24.336Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=55 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5015 command.oublock=8 command.real_time_ms=108 command.spawn_token_fork_ms=0 command.system_time_ms=30 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QJH5J0THV15YSWF0XN1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-06T10:57:34.178" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:57:24.219" grpc.time_ms=116.758 pid=1386 ref=refs/keep-around/af25ac6396f2347124180d83988a5c4d127575f7 remote_ip="2001:db8:1::1" revision=af25ac6396f2347124180d83988a5c4d127575f7 span.kind=server system=grpc username=root2069gitlab # [ 210.507896] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:24.351Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"19fc3812281a393190d98cea","created_at":"2026-07-06T10:57:24.342Z","trace_propagation_headers":{"sentry-trace":"70e425e2558e467b81dcbb08866983da-ad46a56a91ea4148","baggage":"sentry-trace_id=70e425e2558e467b81dcbb08866983da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6QJH5J0THV15YSWF0XN1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:24.345Z","job_size_bytes":65,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-19fc3812281a393190d98cea: start","job_status":"start","queue_duration_s":0.005609,"scheduling_latency_s":0.005656}2070gitlab # [ 210.534109] gitaly[1386]: time="2026-07-06T10:57:24.340Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QJH5J0THV15YSWF0XN1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:54.239" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:24.339" grpc.time_ms=0.902 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab # [ 210.534698] nixbot[3143]: {"ts": "2026-07-06T10:57:24.399Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/14bed34b441f0f8265254b37fea84aefed9c08c4 \"HTTP/1.1 201 Created\""}2072gitlab # [ 210.535750] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/14bed34b441f0f8265254b37fea84aefed9c08c4 HTTP/1.1" 201 651 "" "python-httpx/0.28.1" 3332073gitlab # [ 210.557271] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/af25ac6396f2347124180d83988a5c4d127575f7 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3762074gitlab # [ 210.558410] nixbot[3143]: {"ts": "2026-07-06T10:57:24.427Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/af25ac6396f2347124180d83988a5c4d127575f7 \"HTTP/1.1 201 Created\""}2075gitlab # [ 210.563283] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:24.431Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"19fc3812281a393190d98cea","created_at":"2026-07-06T10:57:24.342Z","trace_propagation_headers":{"sentry-trace":"70e425e2558e467b81dcbb08866983da-ad46a56a91ea4148","baggage":"sentry-trace_id=70e425e2558e467b81dcbb08866983da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6QJH5J0THV15YSWF0XN1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:24.345Z","job_size_bytes":65,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-19fc3812281a393190d98cea: done: 0.080877 sec","job_status":"done","queue_duration_s":0.005609,"scheduling_latency_s":0.005656,"redis_calls":7,"redis_duration_s":0.025708,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.02316,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002548,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.080877,"completed_at":"2026-07-06T10:57:24.431Z","load_balancing_strategy":"primary","db_duration_s":0.00677,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2076gitlab # [ 210.567431] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:24.435Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"9546c870341252e3d0151022","created_at":"2026-07-06T10:57:24.346Z","trace_propagation_headers":{"sentry-trace":"70e425e2558e467b81dcbb08866983da-ad46a56a91ea4148","baggage":"sentry-trace_id=70e425e2558e467b81dcbb08866983da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6QJH5J0THV15YSWF0XN1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:24.348Z","job_size_bytes":65,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-9546c870341252e3d0151022: start","job_status":"start","queue_duration_s":0.087149,"scheduling_latency_s":0.087181}2077gitlab # [ 210.635822] nixbot[3143]: {"ts": "2026-07-06T10:57:24.434Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-af25ac6396f2-59c17a54", "argv0": "bwrap"}2078gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af25ac6396f2347124180d83988a5c4d127575f7'2079gitlab # [ 210.722366] nixbot[3143]: INFO: ::ffff:127.0.0.1:58684 - "GET /api/repos/gitlab/root/test-flake/builds?commit=af25ac6396f2347124180d83988a5c4d127575f7 HTTP/1.1" 200 OK2080gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=af25ac6396f2347124180d83988a5c4d127575f7', in 0.04 seconds)2081(finished: subtest: push delivers the webhook, in 4.58 seconds)2082subtest: eval and build post commit statuses2083gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses2084gitlab # [ 210.749503] nix-daemon[3387]: accepted connection from pid 3529, user nixbot2085gitlab # [ 210.750377] gitaly[1386]: time="2026-07-06T10:57:24.618Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6R2ECDYR7JJ123E2CJVT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:54.416" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:24.617" grpc.time_ms=1.272 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 210.754621] nix-daemon[3387]: accepted connection from pid 3528, user nixbot2087gitlab # [ 210.758542] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:24.627Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"9546c870341252e3d0151022","created_at":"2026-07-06T10:57:24.346Z","trace_propagation_headers":{"sentry-trace":"70e425e2558e467b81dcbb08866983da-ad46a56a91ea4148","baggage":"sentry-trace_id=70e425e2558e467b81dcbb08866983da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6QJH5J0THV15YSWF0XN1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:24.348Z","job_size_bytes":65,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-9546c870341252e3d0151022: done: 0.191886 sec","job_status":"done","queue_duration_s":0.087149,"scheduling_latency_s":0.087181,"redis_calls":10,"redis_duration_s":0.03642,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.032665,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.003755,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.191886,"completed_at":"2026-07-06T10:57:24.626Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025551,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2088gitlab # [ 210.827821] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:24.634Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a9e10c69847f12e1fe0b1927","created_at":"2026-07-06T10:57:24.377Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-09ec66e6e3814ab8","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:24.382Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a9e10c69847f12e1fe0b1927: start","job_status":"start","queue_duration_s":0.252114,"scheduling_latency_s":0.252146}2089gitlab # [ 210.830138] gitaly[1386]: time="2026-07-06T10:57:24.658Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6R2ECDYR7JJ123E2CJVT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:57:34.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:24.651" grpc.time_ms=6.891 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2090gitlab # [ 210.831986] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/14bed34b441f0f8265254b37fea84aefed9c08c4 HTTP/1.1" 201 665 "" "python-httpx/0.28.1" 1422091gitlab # [ 210.833865] nixbot[3143]: {"ts": "2026-07-06T10:57:24.703Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/14bed34b441f0f8265254b37fea84aefed9c08c4 \"HTTP/1.1 201 Created\""}2092gitlab # [ 210.944904] gitaly[1386]: time="2026-07-06T10:57:24.814Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6R93ZF8KHXPDXK8DPRJ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:54.613" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:24.813" grpc.time_ms=0.664 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2093gitlab # [ 210.966245] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 642094gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses, in 0.24 seconds)2095gitlab # [ 211.010594] gitaly[1386]: time="2026-07-06T10:57:24.880Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6QK0K19639QGJN7TBRVS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:24.879" grpc.time_ms=0.486 pid=1386 span.kind=server system=grpc2096gitlab # [ 211.049481] gitaly[1386]: time="2026-07-06T10:57:24.919Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6QK0K19639QGJN7TBRVS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:24.918" grpc.time_ms=0.611 pid=1386 span.kind=server system=grpc2097gitlab # [ 211.090864] gitaly[1386]: time="2026-07-06T10:57:24.960Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6QK0K19639QGJN7TBRVS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:24.960" grpc.time_ms=0.516 pid=1386 span.kind=server system=grpc2098gitlab # [ 211.115100] gitaly[1386]: time="2026-07-06T10:57:24.984Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QK0K19639QGJN7TBRVS diskcache=563404c9-6693-4416-9c31-ad1c7b522b93 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-06T10:57:54.755" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:24.855" pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099gitlab # [ 211.115961] gitaly[1386]: time="2026-07-06T10:57:24.984Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=114 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7461 command.oublock=0 command.real_time_ms=120 command.spawn_token_fork_ms=0 command.system_time_ms=81 command.user_time_ms=33 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QK0K19639QGJN7TBRVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-06T10:57:54.755" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:24.855" grpc.time_ms=128.775 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab # [ 211.325646] gitaly[1386]: time="2026-07-06T10:57:25.195Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6QK0K19639QGJN7TBRVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-06T10:57:55.092" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:25.193" grpc.time_ms=1.821 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2101gitlab # [ 211.441734] gitaly[1386]: time="2026-07-06T10:57:25.311Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QK0K19639QGJN7TBRVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:55.208" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:25.309" grpc.time_ms=1.444 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2102gitlab # [ 211.566283] gitaly[1386]: time="2026-07-06T10:57:25.435Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QK0K19639QGJN7TBRVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:55.333" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:25.434" grpc.time_ms=1.374 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103gitlab # [ 211.601943] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:25.470Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9e2d1f6651ca787cacaf01e4","created_at":"2026-07-06T10:57:25.457Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"a9e10c69847f12e1fe0b1927","job_size_bytes":3,"pid":2138,"job_status":"deduplicated","message":"PipelineProcessWorker JID-9e2d1f6651ca787cacaf01e4: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2104gitlab # [ 211.611759] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:25.479Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a9e10c69847f12e1fe0b1927","created_at":"2026-07-06T10:57:24.377Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-09ec66e6e3814ab8","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:24.382Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2138,"job_status":"rescheduled","message":"PipelineProcessWorker JID-a9e10c69847f12e1fe0b1927: rescheduled"}2105gitlab # [ 211.644813] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:25.512Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a9e10c69847f12e1fe0b1927","created_at":"2026-07-06T10:57:24.377Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-09ec66e6e3814ab8","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:24.382Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a9e10c69847f12e1fe0b1927: done: 0.87821 sec","job_status":"done","queue_duration_s":0.252114,"scheduling_latency_s":0.252146,"gitaly_calls":4,"gitaly_duration_s":0.223277,"redis_calls":104,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.130496,"redis_read_bytes":265,"redis_write_bytes":24009,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00421,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":17,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.006509,"redis_cache_read_bytes":33,"redis_cache_write_bytes":1526,"redis_feature_flag_calls":22,"redis_feature_flag_duration_s":0.037907,"redis_feature_flag_read_bytes":22,"redis_feature_flag_write_bytes":3871,"redis_queues_calls":22,"redis_queues_duration_s":0.019944,"redis_queues_read_bytes":25,"redis_queues_write_bytes":12388,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.039554,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.003163,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003117,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.011882,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":850,"db_count":47,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.195,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.047,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.055,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.112,"db_ci_duration_s":0.083,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.270266,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.76747771,"duration_s":0.87821,"completed_at":"2026-07-06T10:57:25.512Z","load_balancing_strategy":"primary","db_duration_s":0.202107,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2106gitlab # [ 211.676851] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:25.526Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"43d4821c05eecd94ba8fdbe9","created_at":"2026-07-06T10:57:24.408Z","trace_propagation_headers":{"sentry-trace":"70e425e2558e467b81dcbb08866983da-ad46a56a91ea4148","baggage":"sentry-trace_id=70e425e2558e467b81dcbb08866983da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6QJH5J0THV15YSWF0XN1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:24.412Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-43d4821c05eecd94ba8fdbe9: start","job_status":"start","queue_duration_s":1.113972,"scheduling_latency_s":1.114037}2107gitlab # [ 211.828550] gitaly[1386]: time="2026-07-06T10:57:25.698Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6QJH5J0THV15YSWF0XN1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-06T10:57:55.595" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:25.696" grpc.time_ms=1.548 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2108gitlab # [ 211.908175] gitaly[1386]: time="2026-07-06T10:57:25.777Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QJH5J0THV15YSWF0XN1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:55.675" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:25.775" grpc.time_ms=1.467 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses2110gitlab # [ 211.995059] gitaly[1386]: time="2026-07-06T10:57:25.864Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QJH5J0THV15YSWF0XN1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:55.759" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:25.860" grpc.time_ms=3.053 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 212.055602] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:25.925Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"43d4821c05eecd94ba8fdbe9","created_at":"2026-07-06T10:57:24.408Z","trace_propagation_headers":{"sentry-trace":"70e425e2558e467b81dcbb08866983da-ad46a56a91ea4148","baggage":"sentry-trace_id=70e425e2558e467b81dcbb08866983da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6QJH5J0THV15YSWF0XN1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:24.412Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-43d4821c05eecd94ba8fdbe9: done: 0.39902 sec","job_status":"done","queue_duration_s":1.113972,"scheduling_latency_s":1.114037,"gitaly_calls":3,"gitaly_duration_s":0.026694,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.053928,"redis_read_bytes":99,"redis_write_bytes":6014,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.004723,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.015293,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.001982,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.016263,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.002437,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.002228,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006279,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":31,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":31,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.093,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":19,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.013,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.053,"db_ci_duration_s":0.04,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.198583,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.299450628,"duration_s":0.39902,"completed_at":"2026-07-06T10:57:25.925Z","load_balancing_strategy":"primary","db_duration_s":0.100683,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2112gitlab # [ 212.092426] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:25.931Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"005ab30a6e27a46ef214f264","created_at":"2026-07-06T10:57:24.799Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:24.810Z","job_size_bytes":23,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-005ab30a6e27a46ef214f264: start","job_status":"start","queue_duration_s":1.121161,"scheduling_latency_s":1.121193}2113gitlab # [ 212.161574] gitaly[1386]: time="2026-07-06T10:57:26.030Z" level=info msg="finished unary call with code OK" catfile.duration_ms=69 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=69 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6SCMQ4S41P7W69EKFM7A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:55.759" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:25.960" grpc.time_ms=70.395 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 212.180187] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1402115gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses, in 0.21 seconds)2116gitlab # [ 212.234669] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.104Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"005ab30a6e27a46ef214f264","created_at":"2026-07-06T10:57:24.799Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:24.810Z","job_size_bytes":23,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-005ab30a6e27a46ef214f264: done: 0.172352 sec","job_status":"done","queue_duration_s":1.121161,"scheduling_latency_s":1.121193,"redis_calls":15,"redis_duration_s":0.020967,"redis_read_bytes":13,"redis_write_bytes":3011,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002137,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_calls":2,"redis_queues_duration_s":0.000644,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1626,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.010732,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":742,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.00407,"redis_rate_limiting_write_bytes":148,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003384,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":13,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":13,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080359,"worker_id":"sidekiq_0","rate_limiting_gates":["permanent_email_failure","temporary_email_failure"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001156013,"duration_s":0.172352,"completed_at":"2026-07-06T10:57:26.104Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030044,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2117gitlab # [ 212.314965] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.184Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"28e9b88a958353772e74f563","created_at":"2026-07-06T10:57:25.027Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.037Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-28e9b88a958353772e74f563: start","job_status":"start","queue_duration_s":1.146902,"scheduling_latency_s":1.146975}2118gitlab # [ 212.414448] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.282Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"28e9b88a958353772e74f563","created_at":"2026-07-06T10:57:25.027Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.037Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-28e9b88a958353772e74f563: done: 0.098651 sec","job_status":"done","queue_duration_s":1.146902,"scheduling_latency_s":1.146975,"redis_calls":10,"redis_duration_s":0.018457,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003838,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.01282,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001799,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003830654,"duration_s":0.098651,"completed_at":"2026-07-06T10:57:26.282Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015372,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2119gitlab # [ 212.469513] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.292Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cc23b7cebc6aefa7a5a5800b","created_at":"2026-07-06T10:57:25.055Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.070Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cc23b7cebc6aefa7a5a5800b: start","job_status":"start","queue_duration_s":1.221699,"scheduling_latency_s":1.221755}2120gitlab # [ 212.557097] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.426Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cc23b7cebc6aefa7a5a5800b","created_at":"2026-07-06T10:57:25.055Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.070Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cc23b7cebc6aefa7a5a5800b: done: 0.134064 sec","job_status":"done","queue_duration_s":1.221699,"scheduling_latency_s":1.221755,"redis_calls":10,"redis_duration_s":0.014397,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001909,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00889,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003598,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.047,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00103812,"duration_s":0.134064,"completed_at":"2026-07-06T10:57:26.426Z","load_balancing_strategy":"primary","db_duration_s":0.052514,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2121gitlab # [ 212.560601] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.430Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"faee61d0113ed2d4e66369de","created_at":"2026-07-06T10:57:26.083Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-fccfa9c69962477d","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:036185b20ddf054b9fd26b9724d18bdbb5505c4d0b9bc8eed91471dd95a4bcda","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:26.088Z","job_size_bytes":464,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-faee61d0113ed2d4e66369de: start","job_status":"start","queue_duration_s":0.341112,"scheduling_latency_s":0.341183}2122gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses2123gitlab # [ 212.614823] sidekiq-cluster[2138]: {"severity":"WARN","time":"2026-07-06T10:57:26.483Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"faee61d0113ed2d4e66369de","created_at":"2026-07-06T10:57:26.083Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-fccfa9c69962477d","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:036185b20ddf054b9fd26b9724d18bdbb5505c4d0b9bc8eed91471dd95a4bcda","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:26.088Z","job_size_bytes":464,"pid":2138,"sidekiq_tid":"m43a","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-faee61d0113ed2d4e66369de: fail: 0.053237 sec","job_status":"fail","queue_duration_s":0.341112,"scheduling_latency_s":0.341183,"redis_calls":7,"redis_duration_s":0.003954,"redis_read_bytes":5,"redis_write_bytes":786,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002774,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00118,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053237,"completed_at":"2026-07-06T10:57:26.483Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/pipelines.rb:33:in `pipeline_mail'","app/mailers/emails/pipelines.rb:10:in `pipeline_failed_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.00827,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2124gitlab # [ 213.217618] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.486Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"deb5e40c046ae39b4e35de00","created_at":"2026-07-06T10:57:25.087Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.097Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-deb5e40c046ae39b4e35de00: start","job_status":"start","queue_duration_s":1.38879,"scheduling_latency_s":1.388816}2125gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses, in 0.12 seconds)2126gitlab # [ 213.219174] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.598Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"deb5e40c046ae39b4e35de00","created_at":"2026-07-06T10:57:25.087Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.097Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-deb5e40c046ae39b4e35de00: done: 0.111935 sec","job_status":"done","queue_duration_s":1.38879,"scheduling_latency_s":1.388816,"redis_calls":13,"redis_duration_s":0.0046300000000000004,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000843,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000998,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000713,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.077,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.074,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000385524,"duration_s":0.111935,"completed_at":"2026-07-06T10:57:26.598Z","load_balancing_strategy":"primary","db_duration_s":0.076434,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2127gitlab # [ 213.286263] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.599Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"57fb96153c615cb4213c1c65","created_at":"2026-07-06T10:57:25.098Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.113Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-57fb96153c615cb4213c1c65: start","job_status":"start","queue_duration_s":1.486244,"scheduling_latency_s":1.486267}2128gitlab # [ 213.293152] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.627Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"57fb96153c615cb4213c1c65","created_at":"2026-07-06T10:57:25.098Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.113Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-57fb96153c615cb4213c1c65: done: 0.028182 sec","job_status":"done","queue_duration_s":1.486244,"scheduling_latency_s":1.486267,"redis_calls":10,"redis_duration_s":0.002552,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000612,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001477,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000463,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000377143,"duration_s":0.028182,"completed_at":"2026-07-06T10:57:26.627Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2129gitlab # [ 213.392187] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.629Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ec3f7684278144bf090a0868","created_at":"2026-07-06T10:57:25.114Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.140Z","job_size_bytes":19,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ec3f7684278144bf090a0868: start","job_status":"start","queue_duration_s":1.489655,"scheduling_latency_s":1.489677}2130gitlab # [ 213.393380] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.658Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ec3f7684278144bf090a0868","created_at":"2026-07-06T10:57:25.114Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.140Z","job_size_bytes":19,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ec3f7684278144bf090a0868: done: 0.029196 sec","job_status":"done","queue_duration_s":1.489655,"scheduling_latency_s":1.489677,"redis_calls":11,"redis_duration_s":0.002692,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000467,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001769,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000456,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000380216,"duration_s":0.029196,"completed_at":"2026-07-06T10:57:26.658Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003168,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2131gitlab # [ 213.471983] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.660Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f794746a07aa90ab439a9b1b","created_at":"2026-07-06T10:57:25.145Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.162Z","job_size_bytes":65,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f794746a07aa90ab439a9b1b: start","job_status":"start","queue_duration_s":1.498224,"scheduling_latency_s":1.498248}2132gitlab # [ 213.479870] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.686Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f794746a07aa90ab439a9b1b","created_at":"2026-07-06T10:57:25.145Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.162Z","job_size_bytes":65,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f794746a07aa90ab439a9b1b: done: 0.02614 sec","job_status":"done","queue_duration_s":1.498224,"scheduling_latency_s":1.498248,"redis_calls":10,"redis_duration_s":0.002682,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000444,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00178,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000458,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000362616,"duration_s":0.02614,"completed_at":"2026-07-06T10:57:26.686Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003337,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2133gitlab # [ 213.577237] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.688Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"e426d582d9e73d599ebb751b","created_at":"2026-07-06T10:57:25.166Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.174Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-e426d582d9e73d599ebb751b: start","job_status":"start","queue_duration_s":1.513863,"scheduling_latency_s":1.513885}2134gitlab # [ 213.578736] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.713Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"e426d582d9e73d599ebb751b","created_at":"2026-07-06T10:57:25.166Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.174Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-e426d582d9e73d599ebb751b: done: 0.02518 sec","job_status":"done","queue_duration_s":1.513863,"scheduling_latency_s":1.513885,"redis_calls":7,"redis_duration_s":0.001673,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00123,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000443,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02518,"completed_at":"2026-07-06T10:57:26.713Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003259,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2135gitlab # [ 213.650488] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.714Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"7314978f6797d6b40e06b3b6","created_at":"2026-07-06T10:57:25.314Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.335Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7314978f6797d6b40e06b3b6: start","job_status":"start","queue_duration_s":1.378893,"scheduling_latency_s":1.378915}2136gitlab # [ 213.662697] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.743Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"7314978f6797d6b40e06b3b6","created_at":"2026-07-06T10:57:25.314Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.335Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7314978f6797d6b40e06b3b6: done: 0.029113 sec","job_status":"done","queue_duration_s":1.378893,"scheduling_latency_s":1.378915,"redis_calls":10,"redis_duration_s":0.002255,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000439,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001359,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000457,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035172,"duration_s":0.029113,"completed_at":"2026-07-06T10:57:26.743Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007612,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2137gitlab # [ 213.749881] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.745Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"76a9606bc6b79f30fef3bef1","created_at":"2026-07-06T10:57:25.339Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.362Z","job_size_bytes":6,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-76a9606bc6b79f30fef3bef1: start","job_status":"start","queue_duration_s":1.383104,"scheduling_latency_s":1.383124}2138gitlab # [ 213.754208] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.764Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"76a9606bc6b79f30fef3bef1","created_at":"2026-07-06T10:57:25.339Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.362Z","job_size_bytes":6,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-76a9606bc6b79f30fef3bef1: done: 0.019377 sec","job_status":"done","queue_duration_s":1.383104,"scheduling_latency_s":1.383124,"redis_calls":10,"redis_duration_s":0.002264,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000438,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001377,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000390552,"duration_s":0.019377,"completed_at":"2026-07-06T10:57:26.764Z","load_balancing_strategy":"primary","db_duration_s":0.001819,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2139gitlab # [ 213.830095] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.766Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4b41bed0d43e35a3db753c21","created_at":"2026-07-06T10:57:25.482Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.491Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4b41bed0d43e35a3db753c21: start","job_status":"start","queue_duration_s":1.274757,"scheduling_latency_s":1.274778}2140gitlab # [ 213.844417] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.896Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4b41bed0d43e35a3db753c21","created_at":"2026-07-06T10:57:25.482Z","trace_propagation_headers":{"sentry-trace":"cdd0749a8a734eebb98c701af91dac75-2276a852f079468e","baggage":"sentry-trace_id=cdd0749a8a734eebb98c701af91dac75,sentry-release=Unknown"},"correlation_id":"01KWVH6QK0K19639QGJN7TBRVS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.491Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4b41bed0d43e35a3db753c21: done: 0.130382 sec","job_status":"done","queue_duration_s":1.274757,"scheduling_latency_s":1.274778,"gitaly_calls":2,"gitaly_duration_s":0.061539,"redis_calls":19,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.003438,"redis_read_bytes":42,"redis_write_bytes":1891,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000693,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001452,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000236,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":20,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":20,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":9,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.109461957,"duration_s":0.130382,"completed_at":"2026-07-06T10:57:26.896Z","load_balancing_strategy":"primary","db_duration_s":0.014628,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2141gitlab # [ 213.936868] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.898Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c4600bfbdb33405602e8cf37","created_at":"2026-07-06T10:57:25.662Z","trace_propagation_headers":{"sentry-trace":"70e425e2558e467b81dcbb08866983da-e32add54180e4bab","baggage":"sentry-trace_id=70e425e2558e467b81dcbb08866983da,sentry-release=Unknown"},"correlation_id":"01KWVH6QJH5J0THV15YSWF0XN1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.669Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c4600bfbdb33405602e8cf37: start","job_status":"start","queue_duration_s":1.228769,"scheduling_latency_s":1.228834}2142gitlab # [ 213.940118] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:26.923Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c4600bfbdb33405602e8cf37","created_at":"2026-07-06T10:57:25.662Z","trace_propagation_headers":{"sentry-trace":"70e425e2558e467b81dcbb08866983da-e32add54180e4bab","baggage":"sentry-trace_id=70e425e2558e467b81dcbb08866983da,sentry-release=Unknown"},"correlation_id":"01KWVH6QJH5J0THV15YSWF0XN1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:25.669Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c4600bfbdb33405602e8cf37: done: 0.025228 sec","job_status":"done","queue_duration_s":1.228769,"scheduling_latency_s":1.228834,"redis_calls":7,"redis_duration_s":0.002193,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00162,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000573,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025228,"completed_at":"2026-07-06T10:57:26.923Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002918,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2143gitlab # [ 214.011793] gitaly[1386]: time="2026-07-06T10:57:26.854Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6QK0K19639QGJN7TBRVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-06T10:57:56.752" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:26.853" grpc.time_ms=0.879 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2144gitlab # [ 214.026281] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 672145gitlab # [ 214.030103] gitaly[1386]: time="2026-07-06T10:57:26.886Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6QK0K19639QGJN7TBRVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:56.785" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:26.885" grpc.time_ms=0.92 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2146gitlab # [ 214.114447] gitaly[1386]: time="2026-07-06T10:57:27.143Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6THTZPMY25EBMN4G7V84 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:57.041" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:27.142" grpc.time_ms=0.888 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses2148gitlab # [ 214.440862] gitaly[1386]: time="2026-07-06T10:57:28.310Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6VN937QR25FXHTEQXDSV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:58.107" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:28.308" grpc.time_ms=1.328 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2149gitlab # [ 214.481560] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1172150gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses, in 0.18 seconds)2151gitlab # [ 214.943543] nix-daemon[3387]: accepted connection from pid 3591, user nixbot2152gitlab # [ 215.001604] gitaly[1386]: time="2026-07-06T10:57:28.871Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6W69CXXP31B89YZS57B8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:58.668" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:28.869" grpc.time_ms=1.376 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2153gitlab # [ 215.076420] gitaly[1386]: time="2026-07-06T10:57:28.945Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6W69CXXP31B89YZS57B8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:57:38.288" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:28.929" grpc.time_ms=15.375 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2154gitlab # [ 215.161903] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.030Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a783e52f553455b43fd1f079","created_at":"2026-07-06T10:57:29.020Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-224ad9457f4248f4","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.027Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a783e52f553455b43fd1f079: start","job_status":"start","queue_duration_s":0.003033,"scheduling_latency_s":0.003217}2155gitlab # [ 215.208695] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/af25ac6396f2347124180d83988a5c4d127575f7 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 2662156gitlab # [ 215.209986] nixbot[3143]: {"ts": "2026-07-06T10:57:29.046Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/af25ac6396f2347124180d83988a5c4d127575f7 \"HTTP/1.1 201 Created\""}2157gitlab # [ 215.250848] gitaly[1386]: time="2026-07-06T10:57:29.120Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6WEZ3GVMVJHS4WGD9HQ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:59.019" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:29.119" grpc.time_ms=0.8 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2158gitlab # [ 215.292410] gitaly[1386]: time="2026-07-06T10:57:29.162Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6W69CXXP31B89YZS57B8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:29.161" grpc.time_ms=0.669 pid=1386 span.kind=server system=grpc2159gitlab # [ 215.308132] gitaly[1386]: time="2026-07-06T10:57:29.177Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6WEZ3GVMVJHS4WGD9HQ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:57:39.114" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:29.154" grpc.time_ms=23.295 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2160gitlab # [ 215.331189] gitaly[1386]: time="2026-07-06T10:57:29.200Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6W69CXXP31B89YZS57B8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:29.200" grpc.time_ms=0.59 pid=1386 span.kind=server system=grpc2161gitlab # [ 215.362461] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/af25ac6396f2347124180d83988a5c4d127575f7 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1762162gitlab # [ 215.363113] nixbot[3143]: {"ts": "2026-07-06T10:57:29.232Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/af25ac6396f2347124180d83988a5c4d127575f7 \"HTTP/1.1 201 Created\""}2163gitlab # [ 215.375233] gitaly[1386]: time="2026-07-06T10:57:29.245Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH6W69CXXP31B89YZS57B8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:29.244" grpc.time_ms=0.565 pid=1386 span.kind=server system=grpc2164gitlab # [ 215.400376] gitaly[1386]: time="2026-07-06T10:57:29.270Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6W69CXXP31B89YZS57B8 diskcache=8a78ae59-ae0b-44b7-b490-0fa37d53c8d4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-06T10:57:59.032" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:29.135" pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165gitlab # [ 215.400915] gitaly[1386]: time="2026-07-06T10:57:29.270Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=97 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7306 command.oublock=0 command.real_time_ms=126 command.spawn_token_fork_ms=0 command.system_time_ms=66 command.user_time_ms=31 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6W69CXXP31B89YZS57B8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-06T10:57:59.032" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:29.135" grpc.time_ms=135.152 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166gitlab # [ 215.447110] gitaly[1386]: time="2026-07-06T10:57:29.316Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6W69CXXP31B89YZS57B8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-06T10:57:59.215" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:29.315" grpc.time_ms=1.012 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2167gitlab # [ 215.470165] gitaly[1386]: time="2026-07-06T10:57:29.339Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6W69CXXP31B89YZS57B8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:59.238" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:29.338" grpc.time_ms=0.74 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2168gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses2169gitlab # [ 215.521215] gitaly[1386]: time="2026-07-06T10:57:29.390Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6W69CXXP31B89YZS57B8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:59.288" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:29.389" grpc.time_ms=0.831 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2170gitlab # [ 215.530551] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.400Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d05024651e4b028119137668","created_at":"2026-07-06T10:57:29.398Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"a783e52f553455b43fd1f079","job_size_bytes":3,"pid":2138,"job_status":"deduplicated","message":"PipelineProcessWorker JID-d05024651e4b028119137668: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2171gitlab # [ 215.532167] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.401Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a783e52f553455b43fd1f079","created_at":"2026-07-06T10:57:29.020Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-224ad9457f4248f4","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.027Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2138,"job_status":"rescheduled","message":"PipelineProcessWorker JID-a783e52f553455b43fd1f079: rescheduled"}2172gitlab # [ 215.538208] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.407Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a783e52f553455b43fd1f079","created_at":"2026-07-06T10:57:29.020Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-224ad9457f4248f4","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.027Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a783e52f553455b43fd1f079: done: 0.377745 sec","job_status":"done","queue_duration_s":0.003033,"scheduling_latency_s":0.003217,"gitaly_calls":4,"gitaly_duration_s":0.151823,"redis_calls":93,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.022606,"redis_read_bytes":262,"redis_write_bytes":23389,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001507,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.003163,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001264,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":712,"redis_queues_calls":25,"redis_queues_duration_s":0.0046,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14470,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.007077,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000441,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000683,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002364,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":38,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":38,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":23,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.019,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.022,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.03,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.146598,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.337340361,"duration_s":0.377745,"completed_at":"2026-07-06T10:57:29.407Z","load_balancing_strategy":"primary","db_duration_s":0.054721,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2173gitlab # [ 215.615442] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.409Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"50743c6542848457bb1b831b","created_at":"2026-07-06T10:57:29.117Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.122Z","job_size_bytes":23,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-50743c6542848457bb1b831b: start","job_status":"start","queue_duration_s":0.286694,"scheduling_latency_s":0.286717}2174gitlab # [ 215.623072] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.442Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"50743c6542848457bb1b831b","created_at":"2026-07-06T10:57:29.117Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.122Z","job_size_bytes":23,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-50743c6542848457bb1b831b: done: 0.033423 sec","job_status":"done","queue_duration_s":0.286694,"scheduling_latency_s":0.286717,"redis_calls":7,"redis_duration_s":0.002361,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001847,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033423,"completed_at":"2026-07-06T10:57:29.442Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006395,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2175gitlab # [ 215.699130] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.444Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"c842b1d754e3f0e500399c81","created_at":"2026-07-06T10:57:29.276Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.278Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-c842b1d754e3f0e500399c81: start","job_status":"start","queue_duration_s":0.165323,"scheduling_latency_s":0.165346}2176gitlab # [ 215.712177] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.463Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"c842b1d754e3f0e500399c81","created_at":"2026-07-06T10:57:29.276Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.278Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-c842b1d754e3f0e500399c81: done: 0.01881 sec","job_status":"done","queue_duration_s":0.165323,"scheduling_latency_s":0.165346,"redis_calls":7,"redis_duration_s":0.001668,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001204,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01881,"completed_at":"2026-07-06T10:57:29.463Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002327,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2177gitlab # [ 215.779237] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.464Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6151fadc93edae8c86ed0e09","created_at":"2026-07-06T10:57:29.286Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.289Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6151fadc93edae8c86ed0e09: start","job_status":"start","queue_duration_s":0.174714,"scheduling_latency_s":0.174738}2178gitlab # [ 215.859496] gitaly[1386]: time="2026-07-06T10:57:29.530Z" level=info msg="finished unary call with code OK" catfile.duration_ms=103 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=103 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6WSFJF3TATB57DV0RSBW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:59.325" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:29.426" grpc.time_ms=103.522 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2179gitlab # [ 215.860828] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 1722180gitlab # [ 215.861969] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.487Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6151fadc93edae8c86ed0e09","created_at":"2026-07-06T10:57:29.286Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.289Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6151fadc93edae8c86ed0e09: done: 0.022853 sec","job_status":"done","queue_duration_s":0.174714,"scheduling_latency_s":0.174738,"redis_calls":7,"redis_duration_s":0.001704,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001252,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000452,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022853,"completed_at":"2026-07-06T10:57:29.487Z","load_balancing_strategy":"primary","db_duration_s":0.004235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2181gitlab # [ 215.886255] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.489Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"f564c5c90b04fe0192d0511c","created_at":"2026-07-06T10:57:29.298Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.299Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f564c5c90b04fe0192d0511c: start","job_status":"start","queue_duration_s":0.189802,"scheduling_latency_s":0.189825}2182gitlab # [ 215.970312] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.518Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"f564c5c90b04fe0192d0511c","created_at":"2026-07-06T10:57:29.298Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.299Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f564c5c90b04fe0192d0511c: done: 0.029494 sec","job_status":"done","queue_duration_s":0.189802,"scheduling_latency_s":0.189825,"redis_calls":10,"redis_duration_s":0.00417,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001225,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000849,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029494,"completed_at":"2026-07-06T10:57:29.518Z","load_balancing_strategy":"primary","db_duration_s":0.006689,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2183gitlab # [ 215.975385] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.521Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9d85fa23e6bf328fdc256ed0","created_at":"2026-07-06T10:57:29.300Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.301Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9d85fa23e6bf328fdc256ed0: start","job_status":"start","queue_duration_s":0.219617,"scheduling_latency_s":0.219684}2184gitlab # [ 216.056947] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.552Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9d85fa23e6bf328fdc256ed0","created_at":"2026-07-06T10:57:29.300Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.301Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9d85fa23e6bf328fdc256ed0: done: 0.031776 sec","job_status":"done","queue_duration_s":0.219617,"scheduling_latency_s":0.219684,"redis_calls":7,"redis_duration_s":0.0025599999999999998,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001826,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000734,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031776,"completed_at":"2026-07-06T10:57:29.552Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010656,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2185gitlab # [ 216.064199] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.554Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9637bdb8e150e1acb26eae9c","created_at":"2026-07-06T10:57:29.301Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.303Z","job_size_bytes":19,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9637bdb8e150e1acb26eae9c: start","job_status":"start","queue_duration_s":0.250865,"scheduling_latency_s":0.250901}2186gitlab # [ 216.132198] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.577Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9637bdb8e150e1acb26eae9c","created_at":"2026-07-06T10:57:29.301Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.303Z","job_size_bytes":19,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9637bdb8e150e1acb26eae9c: done: 0.022886 sec","job_status":"done","queue_duration_s":0.250865,"scheduling_latency_s":0.250901,"redis_calls":8,"redis_duration_s":0.002144,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001691,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000453,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022886,"completed_at":"2026-07-06T10:57:29.577Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002593,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2187gitlab # [ 216.198527] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.579Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"be9236a1ca752f836454b292","created_at":"2026-07-06T10:57:29.304Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.306Z","job_size_bytes":66,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-be9236a1ca752f836454b292: start","job_status":"start","queue_duration_s":0.272561,"scheduling_latency_s":0.272584}2188gitlab # [ 216.199983] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.595Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"be9236a1ca752f836454b292","created_at":"2026-07-06T10:57:29.304Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.306Z","job_size_bytes":66,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-be9236a1ca752f836454b292: done: 0.017016 sec","job_status":"done","queue_duration_s":0.272561,"scheduling_latency_s":0.272584,"redis_calls":7,"redis_duration_s":0.0016120000000000002,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001131,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017016,"completed_at":"2026-07-06T10:57:29.595Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001157,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2189gitlab # [ 216.267580] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.597Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"1bc942e02009347f1f93a5c0","created_at":"2026-07-06T10:57:29.307Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.309Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1bc942e02009347f1f93a5c0: start","job_status":"start","queue_duration_s":0.287927,"scheduling_latency_s":0.287949}2190gitlab # [ 216.269445] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.622Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"1bc942e02009347f1f93a5c0","created_at":"2026-07-06T10:57:29.307Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.309Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1bc942e02009347f1f93a5c0: done: 0.025295 sec","job_status":"done","queue_duration_s":0.287927,"scheduling_latency_s":0.287949,"redis_calls":7,"redis_duration_s":0.001672,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001226,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000446,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025295,"completed_at":"2026-07-06T10:57:29.622Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003318,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2191gitlab # [ 216.374061] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.624Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"d9a3d6d884afbeac01ef0d45","created_at":"2026-07-06T10:57:29.352Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.355Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d9a3d6d884afbeac01ef0d45: start","job_status":"start","queue_duration_s":0.269029,"scheduling_latency_s":0.269084}2192gitlab # [ 216.375262] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.644Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"d9a3d6d884afbeac01ef0d45","created_at":"2026-07-06T10:57:29.352Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.355Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d9a3d6d884afbeac01ef0d45: done: 0.020032 sec","job_status":"done","queue_duration_s":0.269029,"scheduling_latency_s":0.269084,"redis_calls":7,"redis_duration_s":0.0017499999999999998,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001321,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020032,"completed_at":"2026-07-06T10:57:29.644Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003204,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2193gitlab # [ 216.451260] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.645Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d4c85a14258fcb5d6a771203","created_at":"2026-07-06T10:57:29.355Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.357Z","job_size_bytes":6,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d4c85a14258fcb5d6a771203: start","job_status":"start","queue_duration_s":0.287474,"scheduling_latency_s":0.287496}2194gitlab # [ 216.452404] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.659Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d4c85a14258fcb5d6a771203","created_at":"2026-07-06T10:57:29.355Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.357Z","job_size_bytes":6,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d4c85a14258fcb5d6a771203: done: 0.014507 sec","job_status":"done","queue_duration_s":0.287474,"scheduling_latency_s":0.287496,"redis_calls":7,"redis_duration_s":0.0022040000000000002,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000421,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014507,"completed_at":"2026-07-06T10:57:29.659Z","load_balancing_strategy":"primary","db_duration_s":0.000506,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2195gitlab # [ 216.517938] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.661Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"f51b24a537b733f0c5425d1d","created_at":"2026-07-06T10:57:29.358Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.362Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f51b24a537b733f0c5425d1d: start","job_status":"start","queue_duration_s":0.299287,"scheduling_latency_s":0.299309}2196gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses, in 1.13 seconds)2197gitlab # [ 216.585916] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.689Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"f51b24a537b733f0c5425d1d","created_at":"2026-07-06T10:57:29.358Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.362Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f51b24a537b733f0c5425d1d: done: 0.02856 sec","job_status":"done","queue_duration_s":0.299287,"scheduling_latency_s":0.299309,"redis_calls":10,"redis_duration_s":0.002415,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000448,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001496,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000471,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000402286,"duration_s":0.02856,"completed_at":"2026-07-06T10:57:29.689Z","load_balancing_strategy":"primary","db_duration_s":0.004157,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2198gitlab # [ 216.593124] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.691Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"e1319c74fe357cc1c5a3de77","created_at":"2026-07-06T10:57:29.402Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.403Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e1319c74fe357cc1c5a3de77: start","job_status":"start","queue_duration_s":0.288111,"scheduling_latency_s":0.288132}2199gitlab # [ 216.661285] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.812Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"e1319c74fe357cc1c5a3de77","created_at":"2026-07-06T10:57:29.402Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-1c68f4bd930748c2","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.403Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e1319c74fe357cc1c5a3de77: done: 0.120705 sec","job_status":"done","queue_duration_s":0.288111,"scheduling_latency_s":0.288132,"gitaly_calls":3,"gitaly_duration_s":0.009643,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.008542,"redis_read_bytes":98,"redis_write_bytes":6013,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001417,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001825,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000298,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001656,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000256,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000632,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001041,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":20,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08561,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.098913968,"duration_s":0.120705,"completed_at":"2026-07-06T10:57:29.811Z","load_balancing_strategy":"primary","db_duration_s":0.024404,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2200gitlab # [ 216.734809] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.813Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a12f778e12c371bfb32338c8","created_at":"2026-07-06T10:57:29.745Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-72ac38f58964432d","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.747Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a12f778e12c371bfb32338c8: start","job_status":"start","queue_duration_s":0.066302,"scheduling_latency_s":0.066325}2201gitlab # [ 216.736063] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:29.837Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a12f778e12c371bfb32338c8","created_at":"2026-07-06T10:57:29.745Z","trace_propagation_headers":{"sentry-trace":"0718c2741af34f16b1758257519c1ebb-72ac38f58964432d","baggage":"sentry-trace_id=0718c2741af34f16b1758257519c1ebb,sentry-release=Unknown"},"correlation_id":"01KWVH6W69CXXP31B89YZS57B8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:29.747Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a12f778e12c371bfb32338c8: done: 0.024146 sec","job_status":"done","queue_duration_s":0.066302,"scheduling_latency_s":0.066325,"redis_calls":7,"redis_duration_s":0.0015370000000000002,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001079,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000458,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024146,"completed_at":"2026-07-06T10:57:29.837Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002692,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2202gitlab # [ 216.805603] gitaly[1386]: time="2026-07-06T10:57:29.757Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVH6W69CXXP31B89YZS57B8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-06T10:57:59.655" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:29.756" grpc.time_ms=0.912 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2203gitlab # [ 216.806690] gitaly[1386]: time="2026-07-06T10:57:29.779Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6W69CXXP31B89YZS57B8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:59.677" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:29.778" grpc.time_ms=1.164 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2204gitlab # [ 216.878148] gitaly[1386]: time="2026-07-06T10:57:29.801Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6W69CXXP31B89YZS57B8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:57:59.699" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:29.800" grpc.time_ms=0.671 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2205gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses2206gitlab # [ 217.749518] gitaly[1386]: time="2026-07-06T10:57:31.619Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH6YWQR9K9QNPDJR1PN5WA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:58:01.416" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:31.617" grpc.time_ms=1.396 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2207gitlab # [ 217.842219] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:31 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 1662208gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses, in 0.23 seconds)2209gitlab # [ 217.940359] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:31.808Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"f40c52c3c33329a87aab31c4","created_at":"2026-07-06T10:57:11.431Z","trace_propagation_headers":{"sentry-trace":"daa3b2059a9941ffa86b3e078a6e661d-5017c600e86d4e8f","baggage":"sentry-trace_id=daa3b2059a9941ffa86b3e078a6e661d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6AZK2V2YNWKF6H9FR918","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:f81cdedfcacd69f5b842708be2f4e4b25f0dcbc15f4750aeabdfeba6828aa02e","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:31.805Z","retry_count":0,"job_size_bytes":451,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-f40c52c3c33329a87aab31c4: start","job_status":"start","queue_duration_s":0.003298,"scheduling_latency_s":0.003366}2210gitlab # [ 218.067994] sidekiq-cluster[2138]: {"severity":"WARN","time":"2026-07-06T10:57:31.936Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"f40c52c3c33329a87aab31c4","created_at":"2026-07-06T10:57:11.431Z","trace_propagation_headers":{"sentry-trace":"daa3b2059a9941ffa86b3e078a6e661d-5017c600e86d4e8f","baggage":"sentry-trace_id=daa3b2059a9941ffa86b3e078a6e661d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH6AZK2V2YNWKF6H9FR918","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:f81cdedfcacd69f5b842708be2f4e4b25f0dcbc15f4750aeabdfeba6828aa02e","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:31.805Z","retry_count":0,"job_size_bytes":451,"pid":2138,"sidekiq_tid":"ma8m","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-f40c52c3c33329a87aab31c4: fail: 0.127253 sec","job_status":"fail","queue_duration_s":0.003298,"scheduling_latency_s":0.003366,"redis_calls":7,"redis_duration_s":0.004887,"redis_read_bytes":5,"redis_write_bytes":786,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00333,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001557,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.127253,"completed_at":"2026-07-06T10:57:31.935Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.008937,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2211gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses2212gitlab # [ 218.967391] gitaly[1386]: time="2026-07-06T10:57:32.836Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH70346S7QN2Q9FG7BS0NW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:58:02.734" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:32.835" grpc.time_ms=1.249 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2213gitlab # [ 219.041463] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 1362214gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses, in 0.20 seconds)2215gitlab # [ 219.878672] nix-daemon[3387]: accepted connection from pid 3664, user nixbot2216gitlab # [ 219.999729] gitaly[1386]: time="2026-07-06T10:57:33.868Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH712ZF53B7P82CTDNW8J5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:58:03.765" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:33.866" grpc.time_ms=1.294 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2217gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses2218gitlab # [ 220.034868] gitaly[1386]: time="2026-07-06T10:57:33.904Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVH712ZF53B7P82CTDNW8J5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:57:43.196" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:57:33.897" grpc.time_ms=7.233 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2219gitlab # [ 220.100471] sidekiq-cluster[2138]: {"severity":"INFO","time":"2026-07-06T10:57:33.968Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ff28bd1cd609690965b39d10","created_at":"2026-07-06T10:57:33.960Z","trace_propagation_headers":{"sentry-trace":"70fa8a8cec9e416dbcf76b857379f2f3-4d1a456f69e145f2","baggage":"sentry-trace_id=70fa8a8cec9e416dbcf76b857379f2f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVH712ZF53B7P82CTDNW8J5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-06T10:57:33.965Z","job_size_bytes":3,"pid":2138,"sidekiq_tid":"m7mi","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ff28bd1cd609690965b39d10: start","job_status":"start","queue_duration_s":0.002292,"scheduling_latency_s":0.00234}2220gitlab # [ 220.143769] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/af25ac6396f2347124180d83988a5c4d127575f7 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2202221gitlab # [ 220.146484] nixbot[3143]: {"ts": "2026-07-06T10:57:34.013Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/af25ac6396f2347124180d83988a5c4d127575f7 \"HTTP/1.1 201 Created\""}2222gitlab # [ 220.172856] gitaly[1386]: time="2026-07-06T10:57:34.042Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVH719DCSWHPN9X90QPFBZX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:58:04.040" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:57:34.041" grpc.time_ms=0.638 pid=1386 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2223gitlab # [ 220.218277] gitlab-workhorse[1287]: gitlab 2001:db8:1::1 - - [2026/07/06:10:57:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses HTTP/1.1" 200 1328 "" "curl/8.20.0" 892224gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/af25ac6396f2347124180d83988a5c4d127575f7/statuses, in 0.17 seconds)2225(finished: subtest: eval and build post commit statuses, in 9.49 seconds)2226(finished: run the VM test script, in 256.95 seconds)2227gitlab # [ 220.224503] gitaly[1386]: time="2026-07-06T10:57:34.094Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH712ZF53B7P82CTDNW8J5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:34.093" grpc.time_ms=0.928 pid=1386 span.kind=server system=grpc2228gitlab # [ 220.268784] gitaly[1386]: time="2026-07-06T10:57:34.138Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVH712ZF53B7P82CTDNW8J5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:57:34.136" grpc.time_ms=1.728 pid=1386 span.kind=server system=grpc2229test script finished in 257.02s2230cleanup2231kill QemuMachine (pid 13)2232gitlab # qemu-system-x86_64: terminating on signal 15 from pid 6 (/nix/store/60m4rxhg2fldqaak400c0lry96ijrzqn-python3-3.13.13/bin/python3.13)2233(finished: cleanup, in 1.33 seconds)2234additionally exposed symbols:2235 gitlab,2236 vlan1,2237 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2238[]2239[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-07-06T10:57:18.959Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2240[]2241[]2242[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'af25ac6396f2347124180d83988a5c4d127575f7', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-07-06T10:57:24.018016Z', 'started_at': '2026-07-06T10:57:24.429395Z', 'finished_at': None}]2243[{'id': 2, 'sha': 'af25ac6396f2347124180d83988a5c4d127575f7', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-06T10:57:24.396Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2244[{'id': 2, 'sha': 'af25ac6396f2347124180d83988a5c4d127575f7', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-06T10:57:24.396Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2245[{'id': 2, 'sha': 'af25ac6396f2347124180d83988a5c4d127575f7', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-06T10:57:24.396Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2246[{'id': 2, 'sha': 'af25ac6396f2347124180d83988a5c4d127575f7', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-06T10:57:24.396Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2247[{'id': 2, 'sha': 'af25ac6396f2347124180d83988a5c4d127575f7', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-06T10:57:24.396Z', 'started_at': None, 'finished_at': '2026-07-06T10:57:29.008Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'af25ac6396f2347124180d83988a5c4d127575f7', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-07-06T10:57:29.207Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2248[{'id': 2, 'sha': 'af25ac6396f2347124180d83988a5c4d127575f7', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-06T10:57:24.396Z', 'started_at': None, 'finished_at': '2026-07-06T10:57:29.008Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'af25ac6396f2347124180d83988a5c4d127575f7', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-07-06T10:57:29.207Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2249[{'id': 2, 'sha': 'af25ac6396f2347124180d83988a5c4d127575f7', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-06T10:57:24.396Z', 'started_at': None, 'finished_at': '2026-07-06T10:57:29.008Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'af25ac6396f2347124180d83988a5c4d127575f7', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-07-06T10:57:29.207Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2250[{'id': 2, 'sha': 'af25ac6396f2347124180d83988a5c4d127575f7', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-06T10:57:24.396Z', 'started_at': None, 'finished_at': '2026-07-06T10:57:29.008Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'af25ac6396f2347124180d83988a5c4d127575f7', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-07-06T10:57:29.207Z', 'started_at': None, 'finished_at': '2026-07-06T10:57:33.947Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]