vm-test-run-nixbot-gitlab
x86_64-linux.nixbot-gitlab
· build #113
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 13)11gitlab # Formatting '/build/vm-state-gitlab/tmp.IreKQGTlzf', fmt=raw size=107374182412gitlab # mke2fs 1.47.3 (8-Jul-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15(finished: start all VMs, in 33.99 seconds)16gitlab # Filesystem UUID: fda72f07-bea2-4a2d-bdeb-3d6291dca25517gitlab: waiting for unit setup-gitlab.service18gitlab # Superblock backups stored on blocks:19gitlab: waiting for the VM to finish booting20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... ok45gitlab # [ 0.000000] Linux version 6.18.34 (nixbld@localhost) (gcc (GCC) 15.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Jun 1 15:51:08 UTC 202646gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pziw1zrxxxm7mdmcqrckc8bji4i16iv0-nixos-system-gitlab-test/init regInfo=/nix/store/rpd6irzxdfhhpd567wzilf29nnyx7ni8-closure-info/registration console=ttyS0,115200n8 console=tty047gitlab # [ 0.000000] BIOS-provided physical RAM map:48gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable49gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved51gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved55gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable56gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved57gitlab # [ 0.000000] NX (Execute Disable) protection: active58gitlab # [ 0.000000] APIC: Static calls initialized59gitlab # [ 0.000000] SMBIOS 2.8 present.60gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201461gitlab # [ 0.000000] DMI: Memory slots populated: 1/162gitlab # [ 0.000000] Hypervisor detected: KVM63gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000064gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0065gitlab # [ 0.000000] kvm-clock: using sched offset of 508904554 cycles66gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns67gitlab # [ 0.000004] tsc: Detected 2400.010 MHz processor68gitlab # [ 0.000812] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000069gitlab # [ 0.000849] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs70gitlab # [ 0.000852] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT71gitlab # [ 0.000904] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000072gitlab # [ 0.002754] found SMP MP-table at [mem 0x000f5470-0x000f547f]73gitlab # [ 0.002765] Using GB pages for direct mapping74gitlab # [ 0.002940] RAMDISK: [mem 0xbe4e0000-0xbffcffff]75gitlab # [ 0.002948] ACPI: Early table checksum verification disabled76gitlab # [ 0.002950] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )77gitlab # [ 0.002954] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002957] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002964] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)80gitlab # [ 0.002966] ACPI: FACS 0x00000000BFFE0000 00004081gitlab # [ 0.002968] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002969] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002971] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)84gitlab # [ 0.002972] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]85gitlab # [ 0.002973] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]86gitlab # [ 0.002974] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]87gitlab # [ 0.002974] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]88gitlab # [ 0.002975] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]89gitlab # [ 0.002975] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]90gitlab # [ 0.003461] No NUMA configuration found91gitlab # [ 0.003462] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]92gitlab # [ 0.003465] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]93gitlab # [ 0.005977] Zone ranges:94gitlab # [ 0.005978] DMA [mem 0x0000000000001000-0x0000000000ffffff]95gitlab # [ 0.005980] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]96gitlab # [ 0.005981] Normal [mem 0x0000000100000000-0x00000001bfffffff]97gitlab # [ 0.005982] Device empty98gitlab # [ 0.005983] Movable zone start for each node99gitlab # [ 0.005984] Early memory node ranges100gitlab # [ 0.005984] node 0: [mem 0x0000000000001000-0x000000000009efff]101gitlab # [ 0.005985] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]102gitlab # [ 0.005986] node 0: [mem 0x0000000100000000-0x00000001bfffffff]103gitlab # [ 0.005987] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]104gitlab # [ 0.006008] On node 0, zone DMA: 1 pages in unavailable ranges105gitlab # [ 0.006281] On node 0, zone DMA: 97 pages in unavailable ranges106gitlab # [ 0.114362] On node 0, zone Normal: 40 pages in unavailable ranges107gitlab # [ 0.115388] ACPI: PM-Timer IO Port: 0x608108gitlab # [ 0.115406] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])109gitlab # [ 0.115449] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23110gitlab # [ 0.115452] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)111gitlab # [ 0.115454] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)112gitlab # [ 0.115455] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)113gitlab # [ 0.115456] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)114gitlab # [ 0.115457] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)115gitlab # [ 0.115459] ACPI: Using ACPI (MADT) for SMP configuration information116gitlab # [ 0.115461] ACPI: HPET id: 0x8086a201 base: 0xfed00000117gitlab # [ 0.115467] TSC deadline timer available118gitlab # [ 0.115471] CPU topo: Max. logical packages: 1119gitlab # [ 0.115472] CPU topo: Max. logical dies: 1120gitlab # [ 0.115472] CPU topo: Max. dies per package: 1121gitlab # [ 0.115476] CPU topo: Max. threads per core: 1122gitlab # [ 0.115476] CPU topo: Num. cores per package: 4123gitlab # [ 0.115477] CPU topo: Num. threads per package: 4124gitlab # [ 0.115477] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs125gitlab # [ 0.115503] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()126gitlab # [ 0.115522] kvm-guest: KVM setup pv remote TLB flush127gitlab # [ 0.115526] kvm-guest: setup PV sched yield128gitlab # [ 0.115546] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]129gitlab # [ 0.115548] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]130gitlab # [ 0.115549] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]131gitlab # [ 0.115550] [mem 0xc0000000-0xfeffbfff] available for PCI devices132gitlab # [ 0.115552] Booting paravirtualized kernel on KVM133gitlab # [ 0.115556] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns134gitlab # [ 0.120007] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1135gitlab # [ 0.122257] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288136gitlab # [ 0.122312] kvm-guest: PV spinlocks enabled137gitlab # [ 0.122314] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)138gitlab # [ 0.122317] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/pziw1zrxxxm7mdmcqrckc8bji4i16iv0-nixos-system-gitlab-test/init regInfo=/nix/store/rpd6irzxdfhhpd567wzilf29nnyx7ni8-closure-info/registration console=ttyS0,115200n8 console=tty0139gitlab # [ 0.122415] Unknown kernel command line parameters "regInfo=/nix/store/rpd6irzxdfhhpd567wzilf29nnyx7ni8-closure-info/registration", will be passed to user space.140gitlab # [ 0.122428] random: crng init done141gitlab # [ 0.122428] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes142gitlab # [ 0.131338] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)143gitlab # [ 0.135859] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)144gitlab # [ 0.135937] software IO TLB: area num 4.145gitlab # [ 0.209206] Fallback order for Node 0: 0146gitlab # [ 0.209216] Built 1 zonelists, mobility grouping on. Total pages: 1572726147gitlab # [ 0.209218] Policy zone: Normal148gitlab # [ 0.211712] mem auto-init: stack:all(zero), heap alloc:on, heap free:off149gitlab # [ 0.221343] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1150gitlab # [ 0.234598] allocated 12582912 bytes of page_ext151gitlab # [ 0.244377] ftrace: allocating 48565 entries in 192 pages152gitlab # [ 0.244379] ftrace: allocated 192 pages with 2 groups153gitlab # [ 0.245220] Dynamic Preempt: lazy154gitlab # [ 0.245382] rcu: Preemptible hierarchical RCU implementation.155gitlab # [ 0.245383] rcu: RCU event tracing is enabled.156gitlab # [ 0.245384] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.157gitlab # [ 0.245385] Trampoline variant of Tasks RCU enabled.158gitlab # [ 0.245386] Rude variant of Tasks RCU enabled.159gitlab # [ 0.245386] Tracing variant of Tasks RCU enabled.160gitlab # [ 0.245387] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.161gitlab # [ 0.245387] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4162gitlab # [ 0.245412] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.245414] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.245414] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.165gitlab # [ 0.249718] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16166gitlab # [ 0.250039] rcu: srcu_init: Setting srcu_struct sizes based on contention.167gitlab # [ 0.250159] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.257409] Console: colour VGA+ 80x25169gitlab # [ 0.257413] printk: legacy console [tty0] enabled170gitlab # [ 0.300944] printk: legacy console [ttyS0] enabled171gitlab # [ 0.494273] ACPI: Core revision 20250807172gitlab # [ 0.495797] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.498516] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.500231] x2apic enabled175gitlab # [ 0.501445] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.503149] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.505341] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.508013] kvm-guest: setup PV IPIs179gitlab # [ 0.510299] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.512073] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns181gitlab # [ 0.515118] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400010)182gitlab # [ 0.517233] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.518273] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.519116] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.520120] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.522116] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.524116] Transient Scheduler Attacks: Mitigation: Clear CPU buffers188gitlab # [ 0.525116] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.526116] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.528116] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.530121] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier192gitlab # [ 0.531116] active return thunk: srso_alias_return_thunk193gitlab # [ 0.532143] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'194gitlab # [ 0.533116] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'195gitlab # [ 0.534116] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'196gitlab # [ 0.535116] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'197gitlab # [ 0.536115] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'198gitlab # [ 0.538116] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'199gitlab # [ 0.540116] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'200gitlab # [ 0.542116] x86/fpu: Supporting XSAVE feature 0x800: 'Control-flow User registers'201gitlab # [ 0.544115] x86/fpu: Supporting XSAVE feature 0x1000: 'Control-flow Kernel registers (KVM only)'202gitlab # [ 0.545116] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256203gitlab # [ 0.546116] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64204gitlab # [ 0.547116] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512205gitlab # [ 0.548116] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024206gitlab # [ 0.549115] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8207gitlab # [ 0.551115] x86/fpu: xstate_offset[11]: 2440, xstate_sizes[11]: 16208gitlab # [ 0.552116] x86/fpu: xstate_offset[12]: 2456, xstate_sizes[12]: 24209gitlab # [ 0.553116] x86/fpu: Enabled xstate features 0x1ae7, context size is 2480 bytes, using 'compacted' format.210gitlab # [ 0.582935] Freeing SMP alternatives memory: 44K211gitlab # [ 0.584117] pid_max: default: 32768 minimum: 301212gitlab # [ 0.585232] LSM: initializing lsm=capability,landlock,yama,bpf,ima213gitlab # [ 0.587228] landlock: Up and running.214gitlab # [ 0.588116] Yama: becoming mindful.215gitlab # [ 0.590253] LSM support for eBPF active216gitlab # [ 0.591344] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)217gitlab # [ 0.592261] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)218gitlab # [ 0.595515] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)219gitlab # [ 0.596725] Performance Events: Fam17h+ core perfctr, AMD PMU driver.220gitlab # [ 0.597127] ... version: 2221gitlab # [ 0.598117] ... bit width: 48222gitlab # [ 0.599118] ... generic counters: 6223gitlab # [ 0.600117] ... generic bitmap: 000000000000003f224gitlab # [ 0.601118] ... fixed-purpose counters: 0225gitlab # [ 0.602117] ... fixed-purpose bitmap: 0000000000000000226gitlab # [ 0.603117] ... value mask: 0000ffffffffffff227gitlab # [ 0.604118] ... max period: 00007fffffffffff228gitlab # [ 0.605117] ... global_ctrl mask: 000000000000003f229gitlab # [ 0.606240] signal: max sigframe size: 3376230gitlab # [ 0.607206] rcu: Hierarchical SRCU implementation.231gitlab # [ 0.608122] rcu: Max phase no-delay instances is 400.232gitlab # [ 0.609334] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level233gitlab # [ 0.614557] smp: Bringing up secondary CPUs ...234gitlab # [ 0.615526] smpboot: x86: Booting SMP configuration:235gitlab # [ 0.616127] .... node #0, CPUs: #1 #2 #3236gitlab # [ 0.620252] smp: Brought up 1 node, 4 CPUs237gitlab # [ 0.623121] smpboot: Total of 4 processors activated (19200.08 BogoMIPS)238gitlab # [ 0.624711] Memory: 6013368K/6290904K available (17098K kernel code, 2721K rwdata, 13520K rodata, 3644K init, 3008K bss, 258300K reserved, 0K cma-reserved)239gitlab # [ 0.627117] devtmpfs: initialized240gitlab # [ 0.628317] x86/mm: Memory block size: 128MB241gitlab # [ 0.632180] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns242gitlab # [ 0.633170] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)243gitlab # [ 0.634195] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).244gitlab # [ 0.635221] pinctrl core: initialized pinctrl subsystem245gitlab # [ 0.636480] PM: RTC time: 10:38:27, date: 2026-07-06246gitlab # [ 0.640268] NET: Registered PF_NETLINK/PF_ROUTE protocol family247gitlab # [ 0.642443] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations248gitlab # [ 0.643191] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations249gitlab # [ 0.645206] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations250gitlab # [ 0.646131] audit: initializing netlink subsys (disabled)251gitlab # [ 0.647303] audit: type=2000 audit(1783334307.408:1): state=initialized audit_enabled=0 res=1252gitlab # [ 0.647352] thermal_sys: Registered thermal governor 'fair_share'253gitlab # [ 0.649118] thermal_sys: Registered thermal governor 'bang_bang'254gitlab # [ 0.650119] thermal_sys: Registered thermal governor 'step_wise'255gitlab # [ 0.651118] thermal_sys: Registered thermal governor 'user_space'256gitlab # [ 0.652118] thermal_sys: Registered thermal governor 'power_allocator'257gitlab # [ 0.653171] cpuidle: using governor menu258gitlab # [ 0.656346] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5259gitlab # [ 0.657445] PCI: Using configuration type 1 for base access260gitlab # [ 0.658118] PCI: Using configuration type 1 for extended access261gitlab # [ 0.659286] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.262gitlab # [ 0.661508] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages263gitlab # [ 0.663117] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page264gitlab # [ 0.664118] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages265gitlab # [ 0.665118] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page266gitlab # [ 0.670592] ACPI: Added _OSI(Module Device)267gitlab # [ 0.673126] ACPI: Added _OSI(Processor Device)268gitlab # [ 0.677129] ACPI: Added _OSI(Processor Aggregator Device)269gitlab # [ 0.686047] ACPI: 1 ACPI AML tables successfully acquired and loaded270gitlab # [ 0.697328] ACPI: Interpreter enabled271gitlab # [ 0.698174] ACPI: PM: (supports S0 S3 S4 S5)272gitlab # [ 0.701139] ACPI: Using IOAPIC for interrupt routing273gitlab # [ 0.704584] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug274gitlab # [ 0.711126] PCI: Using E820 reservations for host bridge windows275gitlab # [ 0.716789] ACPI: Enabled 2 GPEs in block 00 to 0F276gitlab # [ 0.732921] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])277gitlab # [ 0.736133] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]278gitlab # [ 0.742329] acpiphp: Slot [3] registered279gitlab # [ 0.745250] acpiphp: Slot [4] registered280gitlab # [ 0.747317] acpiphp: Slot [5] registered281gitlab # [ 0.750284] acpiphp: Slot [6] registered282gitlab # [ 0.752229] acpiphp: Slot [7] registered283gitlab # [ 0.755185] acpiphp: Slot [8] registered284gitlab # [ 0.756182] acpiphp: Slot [9] registered285gitlab # [ 0.757199] acpiphp: Slot [10] registered286gitlab # [ 0.758184] acpiphp: Slot [11] registered287gitlab # [ 0.760182] acpiphp: Slot [12] registered288gitlab # [ 0.761192] acpiphp: Slot [13] registered289gitlab # [ 0.762152] acpiphp: Slot [14] registered290gitlab # [ 0.764158] acpiphp: Slot [15] registered291gitlab # [ 0.765151] acpiphp: Slot [16] registered292gitlab # [ 0.766171] acpiphp: Slot [17] registered293gitlab # [ 0.767461] acpiphp: Slot [18] registered294gitlab # [ 0.771269] acpiphp: Slot [19] registered295gitlab # [ 0.774209] acpiphp: Slot [20] registered296gitlab # [ 0.777207] acpiphp: Slot [21] registered297gitlab # [ 0.780209] acpiphp: Slot [22] registered298gitlab # [ 0.783239] acpiphp: Slot [23] registered299gitlab # [ 0.787235] acpiphp: Slot [24] registered300gitlab # [ 0.790207] acpiphp: Slot [25] registered301gitlab # [ 0.793238] acpiphp: Slot [26] registered302gitlab # [ 0.796208] acpiphp: Slot [27] registered303gitlab # [ 0.799228] acpiphp: Slot [28] registered304gitlab # [ 0.802208] acpiphp: Slot [29] registered305gitlab # [ 0.805240] acpiphp: Slot [30] registered306gitlab # [ 0.808275] acpiphp: Slot [31] registered307gitlab # [ 0.812239] PCI host bridge to bus 0000:00308gitlab # [ 0.815140] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]309gitlab # [ 0.819126] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]310gitlab # [ 0.823125] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]311gitlab # [ 0.827125] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]312gitlab # [ 0.831131] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]313gitlab # [ 0.836174] pci_bus 0000:00: root bus resource [bus 00-ff]314gitlab # [ 0.839679] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint315gitlab # [ 0.847794] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint316gitlab # [ 0.855434] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint317gitlab # [ 0.866288] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]318gitlab # [ 0.870286] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk319gitlab # [ 0.876128] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk320gitlab # [ 0.880128] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk321gitlab # [ 0.885132] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk322gitlab # [ 0.889777] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint323gitlab # [ 0.897261] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]324gitlab # [ 0.901854] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint325gitlab # [ 0.905410] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI326gitlab # [ 0.912172] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB327gitlab # [ 0.917302] pci 0000:00:01.3: quirk_piix4_acpi+0x0/0x180 took 11718 usecs328gitlab # [ 0.924271] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint329gitlab # [ 0.948242] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]330gitlab # [ 0.950146] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]331gitlab # [ 0.952170] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]332gitlab # [ 0.954402] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]333gitlab # [ 0.969182] pci 0000:00:02.0: pci_fixup_video+0x0/0x100 took 14648 usecs334gitlab # [ 0.975970] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint335gitlab # [ 0.992168] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]336gitlab # [ 0.997170] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]337gitlab # [ 1.001303] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]338gitlab # [ 1.007166] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]339gitlab # [ 1.017512] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint340gitlab # [ 1.029157] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]341gitlab # [ 1.032158] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]342gitlab # [ 1.036317] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]343gitlab # [ 1.047286] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint344gitlab # [ 1.061164] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]345gitlab # [ 1.065162] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]346gitlab # [ 1.070276] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]347gitlab # [ 1.080253] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint348gitlab # [ 1.091155] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]349gitlab # [ 1.094184] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]350gitlab # [ 1.098238] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]351gitlab # [ 1.105445] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint352gitlab # [ 1.116163] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]353gitlab # [ 1.120162] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]354gitlab # [ 1.129259] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]355gitlab # [ 1.139499] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint356gitlab # [ 1.153153] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]357gitlab # [ 1.156152] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]358gitlab # [ 1.160230] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]359gitlab # [ 1.168400] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint360gitlab # [ 1.176161] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]361gitlab # [ 1.177134] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]362gitlab # [ 1.180270] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]363gitlab # [ 1.187170] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]364gitlab # [ 1.196784] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint365gitlab # [ 1.207180] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]366gitlab # [ 1.210230] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]367gitlab # [ 1.219199] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint368gitlab # [ 1.228182] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]369gitlab # [ 1.230134] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]370gitlab # [ 1.232172] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]371gitlab # [ 1.236572] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint372gitlab # [ 1.242159] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]373gitlab # [ 1.244151] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]374gitlab # [ 1.246171] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]375gitlab # [ 1.268253] ACPI: PCI: Interrupt link LNKA configured for IRQ 10376gitlab # [ 1.272547] ACPI: PCI: Interrupt link LNKB configured for IRQ 10377gitlab # [ 1.276523] ACPI: PCI: Interrupt link LNKC configured for IRQ 11378gitlab # [ 1.279483] ACPI: PCI: Interrupt link LNKD configured for IRQ 11379gitlab # [ 1.283336] ACPI: PCI: Interrupt link LNKS configured for IRQ 9380gitlab # [ 1.287744] iommu: Default domain type: Translated381gitlab # [ 1.289119] iommu: DMA domain TLB invalidation policy: lazy mode382gitlab # [ 1.292657] ACPI: bus type USB registered383gitlab # [ 1.295346] usbcore: registered new interface driver usbfs384gitlab # [ 1.299176] usbcore: registered new interface driver hub385gitlab # [ 1.303175] usbcore: registered new device driver usb386gitlab # [ 1.310337] NetLabel: Initializing387gitlab # [ 1.313126] NetLabel: domain hash size = 128388gitlab # [ 1.316126] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO389gitlab # [ 1.320292] NetLabel: unlabeled traffic allowed by default390gitlab # [ 1.324170] PCI: Using ACPI for IRQ routing391gitlab # [ 1.329264] pci 0000:00:02.0: vgaarb: setting as boot VGA device392gitlab # [ 1.330113] pci 0000:00:02.0: vgaarb: bridge control possible393gitlab # [ 1.330113] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none394gitlab # [ 1.343132] vgaarb: loaded395gitlab # [ 1.345563] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0396gitlab # [ 1.348123] hpet0: 3 comparators, 64-bit 100.000000 MHz counter397gitlab # [ 1.355155] clocksource: Switched to clocksource kvm-clock398gitlab # [ 1.357727] VFS: Disk quotas dquot_6.6.0399gitlab # [ 1.359107] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)400gitlab # [ 1.361762] pnp: PnP ACPI init401gitlab # [ 1.365175] pnp: PnP ACPI: found 6 devices402gitlab # [ 1.382111] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns403gitlab # [ 1.387874] clocksource: Switched to clocksource acpi_pm404gitlab # [ 1.391592] NET: Registered PF_INET protocol family405gitlab # [ 1.397043] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)406gitlab # [ 1.421672] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)407gitlab # [ 1.424240] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)408gitlab # [ 1.426590] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)409gitlab # [ 1.431674] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)410gitlab # [ 1.433966] TCP: Hash tables configured (established 65536 bind 65536)411gitlab # [ 1.436025] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)412gitlab # [ 1.438293] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)413gitlab # [ 1.440565] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)414gitlab # [ 1.443301] NET: Registered PF_UNIX/PF_LOCAL protocol family415gitlab # [ 1.447913] NET: Registered PF_XDP protocol family416gitlab # [ 1.451787] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]417gitlab # [ 1.456424] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]418gitlab # [ 1.461178] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]419gitlab # [ 1.466134] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]420gitlab # [ 1.471191] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]421gitlab # [ 1.476933] pci 0000:00:01.0: PIIX3: Enabling Passive Release422gitlab # [ 1.481407] pci 0000:00:00.0: Limiting direct PCI/PCI transfers423gitlab # [ 1.489638] ACPI: \_SB_.LNKD: Enabled at IRQ 11424gitlab # [ 1.496296] pci 0000:00:01.2: quirk_usb_early_handoff+0x0/0x7c0 took 10040 usecs425gitlab # [ 1.501254] PCI: CLS 0 bytes, default 64426gitlab # [ 1.503946] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)427gitlab # [ 1.504183] Trying to unpack rootfs image as initramfs...428gitlab # [ 1.504661] software IO TLB: mapped [mem 0x00000000ba4e0000-0x00000000be4e0000] (64MB)429gitlab # [ 1.514229] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns430gitlab # [ 1.567866] Initialise system trusted keyrings431gitlab # [ 1.569759] workingset: timestamp_bits=40 max_order=21 bucket_order=0432gitlab # [ 1.587964] Key type asymmetric registered433gitlab # [ 1.589296] Asymmetric key parser 'x509' registered434gitlab # [ 1.590818] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)435gitlab # [ 1.593453] io scheduler mq-deadline registered436gitlab # [ 1.594860] io scheduler kyber registered437gitlab # [ 1.599815] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled438gitlab # [ 1.602243] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A439gitlab # [ 1.606333] Linux agpgart interface v0.103440gitlab # [ 1.607666] ACPI: bus type drm_connector registered441gitlab # [ 1.610905] usbcore: registered new interface driver usbserial_generic442gitlab # [ 1.612832] usbserial: USB Serial support registered for generic443gitlab # [ 1.614604] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.444gitlab # [ 1.614604] Please enable it if your BIOS has the CPPC option.445gitlab # [ 1.618489] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled446gitlab # [ 1.620814] drop_monitor: Initializing network drop monitor service447gitlab # [ 1.622830] NET: Registered PF_INET6 protocol family448gitlab # [ 1.625559] Segment Routing with IPv6449gitlab # [ 1.626811] In-situ OAM (IOAM) with IPv6450gitlab # [ 1.630914] IPI shorthand broadcast: enabled451gitlab # [ 1.644583] sched_clock: Marking stable (1391075503, 253062696)->(1729661473, -85523274)452gitlab # [ 1.651395] registered taskstats version 1453gitlab # [ 1.655774] Loading compiled-in X.509 certificates454gitlab # [ 1.677673] Demotion targets for Node 0: null455gitlab # [ 1.679608] Key type .fscrypt registered456gitlab # [ 1.681602] Key type fscrypt-provisioning registered457gitlab # [ 1.684638] ima: No TPM chip found, activating TPM-bypass!458gitlab # [ 1.686345] ima: Allocated hash algorithm: sha1459gitlab # [ 1.687846] ima: No architecture policies found460gitlab # [ 1.689635] PM: Magic number: 2:98:628461gitlab # [ 1.691886] RAS: Correctable Errors collector initialized.462gitlab # [ 1.697460] clk: Disabling unused clocks463gitlab # [ 1.698755] PM: genpd: Disabling unused power domains464gitlab # [ 1.811901] Freeing initrd memory: 27584K465gitlab # [ 1.816793] Freeing unused decrypted memory: 2028K466gitlab # [ 1.820420] Freeing unused kernel image (initmem) memory: 3644K467gitlab # [ 1.822271] Write protecting the kernel read-only data: 32768k468gitlab # [ 1.828360] Freeing unused kernel image (text/rodata gap) memory: 1332K469gitlab # [ 1.834935] Freeing unused kernel image (rodata/data gap) memory: 816K470gitlab # [ 1.899239] x86/mm: Checked W+X mappings: passed, no W+X pages found.471gitlab # [ 1.901222] Run /init as init process472gitlab # [ 1.917333] systemd[1]: Inserted module 'autofs4'473gitlab # [ 1.946937] fuse: init (API version 7.45)474gitlab # [ 1.968726] ACPI: \_SB_.LNKC: Enabled at IRQ 10475gitlab # [ 1.978371] ACPI: \_SB_.LNKA: Enabled at IRQ 10476gitlab # [ 1.983814] ACPI: \_SB_.LNKB: Enabled at IRQ 11477gitlab # [ 2.034448] systemd[1]: Successfully made /usr/ read-only.478gitlab # [ 2.373502] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)479gitlab # [ 2.393649] systemd[1]: Detected virtualization kvm.480gitlab # [ 2.397539] systemd[1]: Detected architecture x86-64.481gitlab # [ 2.401427] systemd[1]: Running in initrd.482gitlab # [ 2.405681] systemd[1]: Initializing machine ID from random generator.483gitlab # [ 2.410769] systemd[1]: Hostname set to <gitlab>.484gitlab # [ 2.491097] systemd[1]: Queued start job for default target Initrd Default Target.485gitlab # [ 2.659440] systemd[1]: Created slice Slice /system/modprobe.486gitlab # [ 2.664561] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.487gitlab # [ 2.670533] systemd[1]: Expecting device /dev/disk/by-label/nix-store...488gitlab # [ 2.675559] systemd[1]: Expecting device /dev/disk/by-label/nixos...489gitlab # [ 2.680414] systemd[1]: Reached target Path Units.490gitlab # [ 2.684347] systemd[1]: Reached target Slice Units.491gitlab # [ 2.688386] systemd[1]: Reached target Swaps.492gitlab # [ 2.692151] systemd[1]: Reached target Timer Units.493gitlab # [ 2.696227] systemd[1]: Listening on D-Bus System Message Bus Socket.494gitlab # [ 2.700437] systemd[1]: Listening on Journal Socket (/dev/log).495gitlab # [ 2.704349] systemd[1]: Listening on Journal Sockets.496gitlab # [ 2.707723] systemd[1]: Listening on udev Control Socket.497gitlab # [ 2.711284] systemd[1]: Listening on udev Kernel Socket.498gitlab # [ 2.713513] systemd[1]: Reached target Socket Units.499gitlab # [ 2.719485] systemd[1]: Starting Create List of Static Device Nodes...500gitlab # [ 2.725546] systemd[1]: Starting Load Kernel Module 9pnet_virtio...501gitlab # [ 2.741620] systemd[1]: Starting Load Kernel Module configfs...502gitlab # [ 2.746581] systemd[1]: Starting Journal Service...503gitlab # [ 2.751956] systemd[1]: Starting Load Kernel Modules...504gitlab # [ 2.756402] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki505gitlab # [ 2.768858] systemd[1]: Starting Coldplug All udev Devices...506gitlab # [ 2.774824] systemd-journald[153]: Collecting audit messages is disabled.507gitlab # [ 2.794807] netfs: FS-Cache loaded508gitlab # [ 2.795733] systemd[1]: Finished Create List of Static Device Nodes.509gitlab # [ 2.798774] systemd[1]: modprobe@configfs.service: Deactivated successfully.510gitlab # [ 2.804138] systemd[1]: Finished Load Kernel Module configfs.511gitlab # [ 2.804399] 9pnet: Installing 9P2000 support512gitlab # [ 2.810163] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config513gitlab # [ 2.817193] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...514gitlab # [ 2.821598] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.515gitlab # [ 2.824706] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.516gitlab # [ 2.826916] systemd[1]: Finished Load Kernel Module 9pnet_virtio.517gitlab # [ 2.828340] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev518gitlab # [ 2.842785] systemd[1]: Finished Load Kernel Modules.519gitlab # [ 2.846832] systemd[1]: Starting Apply Kernel Variables...520gitlab # [ 2.850583] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.521gitlab # [ 2.860872] systemd[1]: Starting Create Static Device Nodes in /dev...522gitlab # [ 2.613880] systemd-modules-load[155]: Using 4 probe threads523gitlab # [ 2.615832] systemd-modules-load[155]: Inserted module 'virtio_balloon'524gitlab # [ 2.868766] systemd[1]: Finished Apply Kernel Variables.525gitlab # [ 2.617754] systemd-modules-load[155]: Inserted module 'virtio_gpu'526gitlab # [ 2.620118] systemd-modules-load[155]: Inserted module 'dm_mod'527gitlab # [ 2.873084] systemd[1]: Started Journal Service.528gitlab # [ 2.626123] systemd[1]: Finished Create Static Device Nodes in /dev.529gitlab # [ 2.629792] systemd[1]: Reached target Preparation for Local File Systems.530gitlab # [ 2.631547] systemd[1]: Reached target Local File Systems.531gitlab # [ 2.633444] systemd[1]: Starting Create System Files and Directories...532gitlab # [ 2.650297] systemd[1]: Starting Rule-based Manager for Device Events and Files...533gitlab # [ 2.656662] systemd[1]: Finished Create System Files and Directories.534gitlab # [ 2.668285] systemd-udevd[194]: Using default interface naming scheme 'v260'.535gitlab # [ 2.684390] systemd[1]: Started Rule-based Manager for Device Events and Files.536gitlab # [ 2.711004] systemd[1]: Finished Coldplug All udev Devices.537gitlab # [ 2.712503] systemd[1]: Reached target System Initialization.538gitlab # [ 2.713899] systemd[1]: Reached target Basic System.539gitlab # [ 3.107914] SCSI subsystem initialized540gitlab # [ 3.110128] virtio_blk virtio4: 4/0/0 default/read/poll queues541gitlab # [ 3.117356] uhci_hcd 0000:00:01.2: UHCI Host Controller542gitlab # [ 3.119898] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)543gitlab # [ 3.120120] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1544gitlab # [ 3.126241] uhci_hcd 0000:00:01.2: detected 2 ports545gitlab # [ 3.128288] virtio_blk virtio5: 4/0/0 default/read/poll queues546gitlab # [ 3.128339] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140547gitlab # [ 3.131578] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18548gitlab # [ 3.133409] virtio_blk virtio5: [vdb] 11450712 512-byte logical blocks (5.86 GB/5.46 GiB)549gitlab # [ 3.134734] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1550gitlab # [ 3.137427] usb usb1: Product: UHCI Host Controller551gitlab # [ 3.139476] usb usb1: Manufacturer: Linux 6.18.34 uhci_hcd552gitlab # [ 3.141542] usb usb1: SerialNumber: 0000:00:01.2553gitlab # [ 3.143034] hub 1-0:1.0: USB hub found554gitlab # [ 3.144044] hub 1-0:1.0: 2 ports detected555gitlab # [ 3.157974] scsi host0: ata_piix556gitlab # [ 3.159857] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12557gitlab # [ 3.160418] scsi host1: ata_piix558gitlab # [ 3.162997] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0559gitlab # [ 3.163304] serio: i8042 KBD port at 0x60,0x64 irq 1560gitlab # [ 3.163530] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0561gitlab # [ 3.163790] serio: i8042 AUX port at 0x60,0x64 irq 12562gitlab # [ 2.925576] (udev-worker)[206]: Network interface NamePolicy= disabled on kernel command line.563gitlab # [ 2.930798] (udev-worker)[211]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.564gitlab # [ 2.934656] (udev-worker)[211]: Network interface NamePolicy= disabled on kernel command line.565gitlab # [ 2.944294] systemd[1]: Starting Virtual Console Setup...566gitlab # [ 2.954520] systemd[1]: Found device /dev/disk/by-label/nixos.567gitlab # [ 2.956196] systemd[1]: Reached target Initrd Root Device.568gitlab # [ 2.957503] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...569gitlab # [ 2.960242] systemd[1]: Found device /dev/disk/by-label/nix-store.570gitlab # [ 2.965339] systemd-vconsole-setup[234]: Configuration of first virtual console was skipped, ignoring remaining ones.571gitlab # [ 2.976142] systemd[1]: Finished Virtual Console Setup.572gitlab # [ 2.990726] systemd-fsck[242]: nixos: clean, 12/65536 files, 13019/262144 blocks573gitlab # [ 2.995290] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.574gitlab # [ 3.320457] ata2: found unknown device (class 0)575gitlab # [ 3.325555] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100576gitlab # [ 3.332954] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5577gitlab # [ 3.367235] usb 1-1: new full-speed USB device number 2 using uhci_hcd578gitlab # [ 3.375675] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0579gitlab # [ 3.412236] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray580gitlab # [ 3.443421] cdrom: Uniform CD-ROM driver Revision: 3.20581gitlab # [ 3.537683] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00582gitlab # [ 3.543919] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10583gitlab # [ 3.549416] usb 1-1: Product: QEMU USB Tablet584gitlab # [ 3.552938] usb 1-1: Manufacturer: QEMU585gitlab # [ 3.556020] usb 1-1: SerialNumber: 28754-0000:00:01.2-1586gitlab # [ 3.595590] hid: raw HID events driver (C) Jiri Kosina587gitlab # [ 3.609536] usbcore: registered new interface driver usbhid588gitlab # [ 3.612297] usbhid: USB HID core driver589gitlab # [ 3.624524] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2590gitlab # [ 3.630957] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0591gitlab # [ 3.544990] systemd[1]: Mounting /sysroot...592gitlab # [ 3.980448] EXT4-fs (vda): mounted filesystem fda72f07-bea2-4a2d-bdeb-3d6291dca255 r/w with ordered data mode. Quota mode: none.593gitlab # [ 3.735904] systemd[1]: Mounted /sysroot.594gitlab # [ 3.739307] systemd[1]: Reached target Initrd Root File System.595gitlab # [ 3.743269] systemd[1]: Mounting /sysroot/nix/.ro-store...596gitlab # [ 3.755959] systemd[1]: Mounting /sysroot/nix/.rw-store...597gitlab # [ 3.761972] systemd[1]: Mounting /sysroot/run...598gitlab # [ 4.021743] erofs (device vdb): mounted with root inode @ nid 128.599gitlab # [ 3.770730] systemd[1]: Mounting /sysroot/tmp/shared...600gitlab # [ 3.784966] systemd[1]: Mounting /sysroot/tmp/xchg...601gitlab # [ 4.044553] 9p: Installing v9fs 9p2000 file system support602gitlab # [ 3.792210] systemd[1]: Starting Mountpoints Configured in the Real Root...603gitlab # [ 3.798917] systemd-sysroot-fstab-check[271]: /sysroot should be mounted in the initrd, will request daemon-reload.604gitlab # [ 3.803322] systemd[1]: Mounted /sysroot/nix/.ro-store.605gitlab # [ 3.805501] systemd[1]: Mounted /sysroot/nix/.rw-store.606gitlab # [ 3.807576] systemd[1]: Mounted /sysroot/run.607gitlab # [ 3.809328] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.811283] systemd[1]: Mounted /sysroot/tmp/shared.609gitlab # [ 3.813235] systemd[1]: Reload requested from client PID 271 ('systemd-sysroot') (unit initrd-parse-etc.service)...610gitlab # [ 3.817530] systemd[1]: Reloading...611gitlab # [ 4.030854] systemd[1]: Reloading finished in 221 ms.612gitlab # [ 4.087228] systemd-sysroot-fstab-check[271]: Requesting initrd-fs.target/start/replace...613gitlab # [ 4.240947] systemd-sysroot-fstab-check[271]: Requesting swap.target/start/replace...614gitlab # [ 4.249422] systemd[1]: Starting rw-sysroot-nix-store.service...615gitlab # [ 4.254837] systemd[1]: initrd-parse-etc.service: Deactivated successfully.616gitlab # [ 4.263598] systemd[1]: Finished Mountpoints Configured in the Real Root.617gitlab # [ 4.266959] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.618gitlab # [ 4.275545] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.619gitlab # [ 4.283478] systemd[1]: Finished rw-sysroot-nix-store.service.620gitlab # [ 4.545851] systemd[1]: Mounting /sysroot/nix/store...621gitlab # [ 4.604827] systemd[1]: Mounted /sysroot/nix/store.622gitlab # [ 4.609372] systemd[1]: Reached target Initrd File Systems.623gitlab # [ 4.617890] systemd[1]: Starting Find NixOS closure...624gitlab # [ 4.626253] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...625gitlab # [ 4.661128] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.626gitlab # [ 4.666137] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.627gitlab # [ 4.680320] systemd[1]: Finished Find NixOS closure.628gitlab # [ 4.685794] systemd[1]: Reached target Initrd Default Target.629gitlab # [ 4.693754] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...630gitlab # [ 4.732463] systemd[1]: Stopped target Initrd Default Target.631gitlab # [ 4.735912] systemd[1]: Stopped target Basic System.632gitlab # [ 4.738963] systemd[1]: Stopped target Initrd Root Device.633gitlab # [ 4.742396] systemd[1]: Stopped target Path Units.634gitlab # [ 4.745381] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.635gitlab # [ 4.749738] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.636gitlab # [ 4.754203] systemd[1]: Stopped target Slice Units.637gitlab # [ 4.757281] systemd[1]: Stopped target Socket Units.638gitlab # [ 4.760429] systemd[1]: Stopped target System Initialization.639gitlab # [ 4.763711] systemd[1]: Stopped target Swaps.640gitlab # [ 4.766335] systemd[1]: Stopped target Timer Units.641gitlab # [ 4.769084] systemd[1]: dbus.socket: Deactivated successfully.642gitlab # [ 4.772280] systemd[1]: Closed D-Bus System Message Bus Socket.643gitlab # [ 4.775491] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.644gitlab # [ 4.779227] systemd[1]: Stopped Find NixOS closure.645gitlab # [ 4.781899] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio646gitlab # [ 4.787154] systemd[1]: Starting rw-sysroot-nix-store.service...647gitlab # [ 4.790290] systemd[1]: systemd-sysctl.service: Deactivated successfully.648gitlab # [ 4.793700] systemd[1]: Stopped Apply Kernel Variables.649gitlab # [ 4.796445] systemd[1]: systemd-modules-load.service: Deactivated successfully.650gitlab # [ 4.799458] systemd[1]: Stopped Load Kernel Modules.651gitlab # [ 4.801378] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.652gitlab # [ 4.803663] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.653gitlab # [ 4.808408] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.654gitlab # [ 4.810666] systemd[1]: Stopped Create System Files and Directories.655gitlab # [ 4.816758] systemd[1]: Stopped target Local File Systems.656gitlab # [ 4.818631] systemd[1]: Stopped target Preparation for Local File Systems.657gitlab # [ 4.820761] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.658gitlab # [ 4.822915] systemd[1]: Stopped Coldplug All udev Devices.659gitlab # [ 4.826832] systemd[1]: Stopping Rule-based Manager for Device Events and Files...660gitlab # [ 4.828873] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.661gitlab # [ 4.830589] systemd[1]: Stopped Virtual Console Setup.662gitlab # [ 4.836698] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.663gitlab # [ 4.838780] systemd[1]: Finished rw-sysroot-nix-store.service.664gitlab # [ 4.844421] systemd[1]: systemd-udevd.service: Deactivated successfully.665gitlab # [ 4.846908] systemd[1]: Stopped Rule-based Manager for Device Events and Files.666gitlab # [ 4.849093] systemd[1]: systemd-udevd.service: Consumed 1.023s CPU time over 2.197s wall clock time, 26M memory peak.667gitlab # [ 4.856772] systemd[1]: initrd-cleanup.service: Deactivated successfully.668gitlab # [ 4.860137] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.669gitlab # [ 4.865955] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.670gitlab # [ 4.868202] systemd[1]: Closed udev Control Socket.671gitlab # [ 4.873538] systemd[1]: Starting Cleanup udev Database...672gitlab # [ 4.875419] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.673gitlab # [ 4.877723] systemd[1]: Stopped Create Static Device Nodes in /dev.674gitlab # [ 4.882595] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.675gitlab # [ 4.884977] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.676gitlab # [ 4.890373] systemd[1]: kmod-static-nodes.service: Deactivated successfully.677gitlab # [ 4.892490] systemd[1]: Stopped Create List of Static Device Nodes.678gitlab # [ 4.899156] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.679gitlab # [ 4.903793] systemd[1]: Finished Cleanup udev Database.680gitlab # [ 4.909958] systemd[1]: Reached target Switch Root.681gitlab # [ 4.915506] systemd[1]: Starting NixOS Activation...682gitlab # [ 5.047997] initrd-nixos-activation-start[562]: booting system configuration /nix/store/pziw1zrxxxm7mdmcqrckc8bji4i16iv0-nixos-system-gitlab-test683gitlab # [ 5.094826] initrd-nixos-activation-start[562]: running activation script...684gitlab # [ 5.342807] initrd-nixos-activation-start[585]: setting up /etc...685gitlab # [ 5.463403] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.686gitlab # [ 5.471925] systemd[1]: Finished NixOS Activation.687gitlab # [ 5.487694] systemd[1]: Starting Switch Root...688gitlab # [ 5.527314] systemd[1]: Switching root.689gitlab # [ 6.177401] systemd-journald[153]: Received SIGTERM from PID 1 (systemd).690gitlab # [ 6.307808] NET: Registered PF_VSOCK protocol family691gitlab # [ 6.675153] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)692gitlab # [ 6.684955] systemd[1]: Detected virtualization kvm.693gitlab # [ 6.688163] systemd[1]: Detected architecture x86-64.694gitlab # [ 6.691346] systemd[1]: Detected first boot.695gitlab # [ 6.695373] systemd[1]: Initializing machine ID from random generator.696gitlab # [ 6.845256] systemd[1]: bpf-restrict-fs: LSM BPF program attached697gitlab # [ 6.914656] systemd[1]: Applying preset policy.698gitlab # [ 7.074712] systemd[1]: Populated /etc with preset unit settings.699gitlab # [ 7.186744] systemd[1]: initrd-switch-root.service: Deactivated successfully.700gitlab # [ 7.189120] systemd[1]: Stopped initrd-switch-root.service.701gitlab # [ 7.192432] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.702gitlab # [ 7.195514] systemd[1]: Created slice Slice /system/getty.703gitlab # [ 7.197693] systemd[1]: Created slice GitLab DevOps Platform Slice.704gitlab # [ 7.199888] systemd[1]: Created slice User and Session Slice.705gitlab # [ 7.201449] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.706gitlab # [ 7.203462] systemd[1]: Started Forward Password Requests to Wall Directory Watch.707gitlab # [ 7.205344] systemd[1]: Expecting device /dev/hvc0...708gitlab # [ 7.206603] systemd[1]: Expecting device /dev/ttyS0...709gitlab # [ 7.207942] systemd[1]: Reached target Local Encrypted Volumes.710gitlab # [ 7.209439] systemd[1]: Stopped target initrd-fs.target.711gitlab # [ 7.210753] systemd[1]: Stopped target initrd-root-fs.target.712gitlab # [ 7.212195] systemd[1]: Stopped target initrd-switch-root.target.713gitlab # [ 7.213688] systemd[1]: Reached target Virtual Machines and Containers.714gitlab # [ 7.215347] systemd[1]: Reached target Path Units.715gitlab # [ 7.216598] systemd[1]: Reached target Remote File Systems.716gitlab # [ 7.217993] systemd[1]: Reached target Slice Units.717gitlab # [ 7.219284] systemd[1]: Reached target Swaps.718gitlab # [ 7.221516] systemd[1]: Listening on Process Core Dump Socket.719gitlab # [ 7.223641] systemd[1]: Listening on Credential Encryption/Decryption.720gitlab # [ 7.226882] systemd[1]: Starting Journal Log Access Socket...721gitlab # [ 7.229099] systemd[1]: Listening on Journal Audit Socket.722gitlab # [ 7.230786] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 7.232623] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki724gitlab # [ 7.234993] systemd[1]: Listening on udev Control Socket.725gitlab # [ 7.238451] systemd[1]: Mounting Huge Pages File System...726gitlab # [ 7.241425] systemd[1]: Mounting POSIX Message Queue File System...727gitlab # [ 7.244622] systemd[1]: Mounting Kernel Debug File System...728gitlab # [ 7.248375] systemd[1]: Mounting Kernel Trace File System...729gitlab # [ 7.260095] systemd[1]: Starting Create List of Static Device Nodes...730gitlab # [ 7.262176] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio731gitlab # [ 7.268176] systemd[1]: Starting Load Kernel Module configfs...732gitlab # [ 7.269637] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm733gitlab # [ 7.271967] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore734gitlab # [ 7.272231] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse735gitlab # [ 7.283312] systemd[1]: Mounting FUSE Control File System...736gitlab # [ 7.296629] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67737gitlab # [ 7.317372] systemd[1]: Starting Journal Service...738gitlab # [ 7.320161] systemd[1]: Starting Load Kernel Modules...739gitlab # [ 7.324981] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...740gitlab # [ 7.334376] systemd[1]: Starting Remount Root and Kernel File Systems...741gitlab # [ 7.341205] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki742gitlab # [ 7.345433] loop: module loaded743gitlab # [ 7.346627] systemd-journald[781]: Collecting audit messages is enabled.744gitlab # [ 7.352719] systemd[1]: Starting Coldplug All udev Devices...745gitlab # [ 7.358995] systemd[1]: Listening on Journal Log Access Socket.746gitlab # [ 7.360708] systemd[1]: Mounted Huge Pages File System.747gitlab # [ 7.362343] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.748gitlab # [ 7.109705] systemd[1]: Queued start job for [ 7.364140] systemd[1]: Started Journal Service.749gitlab # default target Multi-User System.750gitlab # [ 7.113882] systemd[1]: Unnecessary job was removed for /dev/vdb.751gitlab # [ 7.115955] systemd[1]: systemd-journald.service: Deactivated successfully.752gitlab # [ 7.118211] systemd-modules-load[782]: Using 3 probe threads753gitlab # [ 7.371213] EXT4-fs (vda): re-mounted fda72f07-bea2-4a2d-bdeb-3d6291dca255.754gitlab # [ 7.121638] systemd-modules-load[782]: Inserted module 'loop'755gitlab # [ 7.124141] systemd-modules-load[782]: Inserted module 'tls'756gitlab # [ 7.126185] systemd-oomd[783]: No swap; memory pressure usage will be degraded757gitlab # [ 7.128914] systemd[1]: Mounted POSIX Message Queue File System.758gitlab # [ 7.130937] systemd[1]: Mounted Kernel Debug File System.759gitlab # [ 7.132700] systemd[1]: Mounted Kernel Trace File System.760gitlab # [ 7.134502] systemd[1]: Finished Create List of Static Device Nodes.761gitlab # [ 7.136422] systemd[1]: modprobe@configfs.service: Deactivated successfully.762gitlab # [ 7.138469] systemd[1]: Finished Load Kernel Module configfs.763gitlab # [ 7.140339] systemd[1]: Mounted FUSE Control File System.764gitlab # [ 7.142612] systemd[1]: Finished Load Kernel Modules.765gitlab # [ 7.144221] systemd[1]: Mounting Kernel Configuration File System...766gitlab # [ 7.146258] systemd[1]: Starting Firewall...767gitlab # [ 7.148252] systemd[1]: Starting Apply Kernel Variables...768gitlab # [ 7.150402] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...769gitlab # [ 7.152682] systemd[1]: Finished Remount Root and Kernel File Systems.770gitlab # [ 7.156407] systemd[1]: Mounted Kernel Configuration File System.771gitlab # [ 7.159906] systemd[1]: Starting Flush Journal to Persistent Storage...772gitlab # [ 7.161782] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore773gitlab # [ 7.164908] systemd[1]: Starting Load/Save OS Random Seed...774gitlab # [ 7.166451] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki775gitlab # [ 7.173466] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.776gitlab # [ 7.177968] systemd[1]: Finished Apply Kernel Variables.777gitlab # [ 7.181245] systemd[1]: Starting Create Static Device Nodes in /dev...778gitlab # [ 7.436245] systemd-journald[781]: Received client request to flush runtime journal.779gitlab # [ 7.253340] systemd[1]: Finished Load/Save OS Random Seed.780gitlab # [ 7.256181] systemd[1]: Finished Create Static Device Nodes in /dev.781gitlab # [ 7.257990] systemd[1]: Reached target First Boot Complete.782gitlab # [ 7.259419] systemd[1]: Reached target Preparation for Local File Systems.783gitlab # [ 7.261166] systemd[1]: Starting Rule-based Manager for Device Events and Files...784gitlab # [ 7.263364] systemd-udevd[820]: Using default interface naming scheme 'v260'.785gitlab # [ 7.265279] systemd[1]: Finished Flush Journal to Persistent Storage.786gitlab # [ 7.297946] systemd[1]: Started Rule-based Manager for Device Events and Files.787gitlab # [ 7.324717] systemd[1]: Finished Coldplug All udev Devices.788gitlab # [ 7.418115] systemd[1]: Finished Firewall.789gitlab # [ 7.431531] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse790gitlab # [ 7.477097] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.791gitlab # [ 7.482259] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.792gitlab # [ 7.486455] (udev-worker)[921]: Network interface NamePolicy= disabled on kernel command line.793gitlab # [ 7.490504] (udev-worker)[909]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.794gitlab # [ 7.494086] (udev-worker)[909]: Network interface NamePolicy= disabled on kernel command line.795gitlab # [ 7.510677] systemd[1]: Condition check resulted in Virtio network device being skipped.796gitlab # [ 7.512604] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore797gitlab # [ 7.516162] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67798gitlab # [ 7.519981] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore799gitlab # [ 7.522748] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki800gitlab # [ 7.525126] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki801gitlab # [ 7.802469] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3802gitlab # [ 7.802967] mousedev: PS/2 mouse device common for all mice803gitlab # [ 7.810524] ACPI: button: Power Button [PWRF]804gitlab # [ 7.847948] rtc_cmos 00:05: RTC can wake from S4805gitlab # [ 7.857312] rtc_cmos 00:05: registered as rtc0806gitlab # [ 7.857550] parport_pc 00:03: reported by Plug and Play ACPI807gitlab # [ 7.857616] Floppy drive(s):808gitlab # [ 7.857788] rtc_cmos 00:05: setting system clock to 2026-07-06T10:38:34 UTC (1783334314)809gitlab # [ 7.858011] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs810gitlab # [ 7.860642] parport0: PC-style at 0x378811gitlab # [ 7.860747] fd0 is 2.88M AMI BIOS812gitlab # [ 7.862325] , irq 7813gitlab # [ 7.863442]814gitlab # [ 7.863709] [PCSPP(,...)]815gitlab # [ 7.867921] systemd-journald[781]: Time jumped backwards, rotating.816gitlab # [ 7.876193] FDC 0 is a S82078B817gitlab # [ 7.893947] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console818gitlab # [ 7.913110] Console: switching to colour dummy device 80x25819gitlab # [ 7.914486] [drm] Found bochs VGA, ID 0xb0c5.820gitlab # [ 7.915327] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.821gitlab # [ 7.920102] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic822gitlab # [ 7.922235] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0823gitlab # [ 7.928196] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5824gitlab # [ 7.929953] fbcon: bochs-drmdrmfb (fb0) is primary device825gitlab # [ 7.935284] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4826gitlab # [ 7.935309] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0827gitlab # [ 7.937233] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD828gitlab # [ 7.939707] Console: switching to colour frame buffer device 160x50829gitlab # [ 7.947870] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device830gitlab # [ 7.959152] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6831gitlab # [ 7.776441] systemd[1]: Starting Virtual Console Setup...832gitlab # [ 7.815228] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.833gitlab # [ 8.071171] ppdev: user-space parallel port driver834gitlab # [ 7.825168] systemd[1]: Stopped Virtual Console Setup.835gitlab # [ 7.841957] systemd[1]: Starting Virtual Console Setup...836gitlab # [ 8.128560] kvm_amd: TSC scaling supported837gitlab # [ 8.129592] kvm_amd: Nested Virtualization enabled838gitlab # [ 8.130742] kvm_amd: Nested Paging enabled839gitlab # [ 8.131789] kvm_amd: LBR virtualization supported840gitlab # [ 8.132875] kvm_amd: Virtual VMLOAD VMSAVE supported841gitlab # [ 8.134098] kvm_amd: Virtual GIF supported842gitlab # [ 8.134922] kvm_amd: Virtual NMI enabled843gitlab # [ 8.185761] EDAC MC: Ver: 3.0.0844gitlab # [ 7.936239] systemd[1]: Mounting /run/wrappers...845gitlab # [ 7.946297] systemd-vconsole-setup[956]: Configuration of first virtual console was skipped, ignoring remaining ones.846gitlab # [ 7.950173] systemd[1]: Finished Virtual Console Setup.847gitlab # [ 7.955550] systemd[1]: Mounted /run/wrappers.848gitlab # [ 7.957654] systemd[1]: Reached target Local File Systems.849gitlab # [ 7.959562] systemd[1]: Listening on Boot Loader Control Service Socket.850gitlab # [ 7.962440] systemd[1]: Starting register-nix-paths.service...851gitlab # [ 7.965091] systemd[1]: Starting Create SUID/SGID Wrappers...852gitlab # [ 7.967217] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.853gitlab # [ 7.972890] systemd[1]: Starting Save Transient machine-id to Disk...854gitlab # [ 7.977386] systemd[1]: Starting Create System Files and Directories...855gitlab # [ 7.997563] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.856gitlab # [ 8.001336] systemd[1]: Finished Save Transient machine-id to Disk.857gitlab # [ 8.016775] systemd[1]: Finished Create System Files and Directories.858gitlab # [ 8.019436] systemd[1]: Starting Rebuild Journal Catalog...859gitlab # [ 8.022067] systemd[1]: Starting Record System Boot/Shutdown in UTMP...860gitlab # [ 8.036882] systemd[1]: Finished Record System Boot/Shutdown in UTMP.861gitlab # [ 8.054620] systemd[1]: Finished Rebuild Journal Catalog.862gitlab # [ 8.058464] systemd[1]: Starting Update is Completed...863gitlab # [ 8.080761] systemd[1]: Finished Update is Completed.864gitlab # [ 8.109244] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.865gitlab # [ 8.111450] systemd[1]: Finished Create SUID/SGID Wrappers.866gitlab # [ 8.112850] systemd[1]: suid-sgid-wrappers.service: Consumed 119ms CPU time over 143ms wall clock time, 4.5M memory peak, 1.1M read from disk.867gitlab # [ 8.396686] systemd[1]: Finished register-nix-paths.service.868gitlab # [ 8.402424] systemd[1]: Reached target System Initialization.869gitlab # [ 8.407107] systemd[1]: Started Discard unused filesystem blocks once a week.870gitlab # [ 8.411289] systemd[1]: Started logrotate.timer.871gitlab # [ 8.414242] systemd[1]: Started Daily Cleanup of Temporary Directories.872gitlab # [ 8.418143] systemd[1]: Reached target Timer Units.873gitlab # [ 8.421282] systemd[1]: Listening on D-Bus System Message Bus Socket.874gitlab # [ 8.425192] systemd[1]: Listening on Nix Daemon Socket.875gitlab # [ 8.439741] systemd[1]: Starting nixbot CI service socket...876gitlab # [ 8.443261] systemd[1]: Listening on Hostname Service Socket.877gitlab # [ 8.450107] systemd[1]: Starting D-Bus System Message Bus...878gitlab # [ 8.453553] systemd[1]: Listening on nixbot CI service socket.879gitlab # [ 8.457229] systemd[1]: Reached target Socket Units.880gitlab # [ 8.516126] dbus-broker-launch[1046]: Looking up NSS user entry for 'systemd-timesync'...881gitlab # [ 8.521634] dbus-broker-launch[1046]: NSS returned no entry for 'systemd-timesync'882gitlab # [ 8.526299] dbus-broker-launch[1046]: Invalid user-name in /nix/store/89zj9nmrajvcy9c3c08wv0ir9ww7lgmq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"883gitlab # [ 8.535414] systemd[1]: Started D-Bus System Message Bus.884gitlab # [ 8.545580] dbus-broker-launch[1046]: Ready885gitlab # [ 8.553937] systemd[1]: Reached target Basic System.886gitlab # [ 8.558241] systemd[1]: Started backdoor.service.887gitlab # [ 8.561838] systemd[1]: Starting gitlab-config.service...888gitlab # [ 8.566184] systemd[1]: Starting Import lastlog data into lastlog2 database...889gitlab # [ 8.578158] systemd[1]: Starting Logrotate configuration check...890gitlab # [ 8.583695] systemd[1]: Starting Name Service Cache Daemon (nsncd)...891gitlab # [ 8.590565] systemd[1]: Starting Post-Boot Actions...892gitlab # [ 8.595189] systemd[1]: Started Reset console on configuration changes.893gitlab # [ 8.608848] systemd[1]: Starting resolvconf update...894gitlab # connecting to host...895gitlab # [ 8.613332] logrotate[1051]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.896gitlab # [ 8.614480] logrotate[1051]: reading config file /nix/store/sn4bd2nqi3yg4r51djm9i2rmfgbwvmhb-logrotate.conf897gitlab # [ 8.615325] logrotate[1051]: note: 'monthly' overrides previously specified 'weekly'898gitlab # [ 8.616196] logrotate[1051]: Reading state from file: /var/lib/logrotate.status899gitlab: Guest shell says: b'Spawning backdoor root shell...\n'900gitlab: connected to guest root shell901gitlab # [ 8.617066] logrotate[1051]: state file /var/lib/logrotate.status does not exist902gitlab: (connecting took 9.47 seconds)903gitlab # [ 8.617926] logrotate[1051]: Allocating hash table for state file, size 64 entries904gitlab: (finished: waiting for the VM to finish booting, in 9.47 seconds)905gitlab # [ 8.619167] logrotate[1051]: Handling 4 logs906gitlab # [ 8.619755] logrotate[1051]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed907gitlab # [ 8.620361] logrotate[1051]: considering log /var/log/btmp908gitlab # [ 8.621197] logrotate[1051]: Creating new state909gitlab # [ 8.622093] logrotate[1051]: Now: 2026-07-06 10:38910gitlab # [ 8.623073] logrotate[1051]: Last rotated at 2026-07-06 10:00911gitlab # [ 8.623826] logrotate[1051]: log does not need rotating (log has already been rotated)912gitlab # [ 8.624871] logrotate[1051]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed913gitlab # [ 8.625976] logrotate[1051]: considering log /var/log/wtmp914gitlab # [ 8.626981] logrotate[1051]: Creating new state915gitlab # [ 8.628074] logrotate[1051]: Now: 2026-07-06 10:38916gitlab # [ 8.628851] logrotate[1051]: Last rotated at 2026-07-06 10:00917gitlab # [ 8.629956] logrotate[1051]: log does not need rotating (log has already been rotated)918gitlab # [ 8.631051] logrotate[1051]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed919gitlab # [ 8.631784] logrotate[1051]: switching euid from 0 to 165 and egid from 0 to 165 (pid 1051)920gitlab # [ 8.632863] logrotate[1051]: considering log /var/gitlab/state/log/*.log921gitlab # [ 8.634072] logrotate[1051]: log /var/gitlab/state/log/*.log does not exist -- skipping922gitlab # [ 8.634843] logrotate[1051]: Creating new state923gitlab # [ 8.635969] logrotate[1051]: switching euid from 165 to 0 and egid from 165 to 0 (pid 1051)924gitlab # [ 8.637192] logrotate[1051]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed925gitlab # [ 8.638043] logrotate[1051]: switching euid from 0 to 60 and egid from 0 to 60 (pid 1051)926gitlab # [ 8.638882] logrotate[1051]: considering log /var/log/nginx/*.log927gitlab # [ 8.639991] logrotate[1051]: log /var/log/nginx/*.log does not exist -- skipping928gitlab # [ 8.642492] logrotate[1051]: Creating new state929gitlab # [ 8.643275] logrotate[1051]: switching euid from 60 to 0 and egid from 60 to 0 (pid 1051)930gitlab # [ 8.644414] systemd[1]: Finished Logrotate configuration check.931gitlab # [ 8.645623] systemd[1]: Finished Post-Boot Actions.932gitlab # [ 8.669821] systemd[1]: Finished Import lastlog data into lastlog2 database.933gitlab # [ 8.697633] nsncd[1052]: Jul 06 10:38:35.590 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"934gitlab # [ 8.698938] systemd[1]: Started Name Service Cache Daemon (nsncd).935gitlab # [ 8.699882] systemd[1]: Reached target Host and Network Name Lookups.936gitlab # [ 8.703851] systemd[1]: Reached target User and Group Name Lookups.937gitlab # [ 8.706827] systemd[1]: Starting User Login Management...938gitlab # [ 8.714628] systemd[1]: Stopped target Host and Network Name Lookups.939gitlab # [ 8.716459] systemd[1]: Stopping Host and Network Name Lookups...940gitlab # [ 8.718119] systemd[1]: Stopped target User and Group Name Lookups.941gitlab # [ 8.720179] systemd[1]: Stopping User and Group Name Lookups...942gitlab # [ 8.721792] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...943gitlab # [ 8.723472] systemd[1]: nscd.service: Deactivated successfully.944gitlab # [ 8.725101] systemd[1]: Stopped Name Service Cache Daemon (nsncd).945gitlab # [ 8.726708] systemd[1]: nscd.service: Consumed 21ms CPU time over 135ms wall clock time, 7.8M memory peak, 5.7M read from disk.946gitlab # [ 8.729688] systemd[1]: Starting Name Service Cache Daemon (nsncd)...947gitlab # [ 8.745889] systemd[1]: Started Name Service Cache Daemon (nsncd).948gitlab # [ 8.747830] nsncd[1135]: Jul 06 10:38:35.640 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"949gitlab # [ 8.751389] systemd[1]: Reached target Host and Network Name Lookups.950gitlab # [ 8.753849] systemd[1]: Reached target User and Group Name Lookups.951gitlab # [ 8.759875] systemd-logind[1116]: New seat seat0.952gitlab # [ 8.761478] systemd[1]: Finished resolvconf update.953gitlab # [ 8.762654] systemd[1]: Reached target Preparation for Network.954gitlab # [ 8.767284] systemd[1]: Starting DHCP Client...955gitlab # [ 8.770187] systemd[1]: Starting Address configuration of eth1...956gitlab # [ 8.771282] systemd-logind[1116]: Watching system buttons on /dev/input/event2 (Power Button)957gitlab # [ 8.773728] systemd-logind[1116]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)958gitlab # [ 8.776146] systemd-logind[1116]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)959gitlab # [ 8.777849] systemd[1]: Starting Extra networking commands....960gitlab # [ 8.779212] systemd[1]: Started User Login Management.961gitlab # [ 8.783347] systemd[1]: Starting linger-users.service...962gitlab # [ 8.802852] systemd[1]: linger-users.service: Deactivated successfully.963gitlab # [ 8.805844] systemd[1]: Finished linger-users.service.964gitlab # [ 8.809539] network-addresses-eth1-start[1161]: adding address 192.168.1.1/24... done965gitlab # [ 8.812943] network-addresses-eth1-start[1161]: adding address 2001:db8:1::1/64... done966gitlab # [ 8.821443] systemd[1]: Finished Address configuration of eth1.967gitlab # [ 8.859486] systemd[1]: Finished Extra networking commands..968gitlab # [ 8.861294] systemd[1]: Reached target Network.969gitlab # [ 8.863626] dhcpcd[1175]: dhcpcd-10.3.2 starting970gitlab # [ 8.864880] systemd[1]: Starting gitlab-workhorse.service...971gitlab # [ 8.866042] systemd[1]: Starting Nginx Web Server...972gitlab # [ 8.870669] dhcpcd[1224]: dev: loaded udev973gitlab # [ 8.873254] systemd[1]: Starting PostgreSQL Server...974gitlab # [ 9.129875] 8021q: 802.1Q VLAN Support v1.8975gitlab # [ 9.130893] 8021q: adding VLAN 0 to HW filter on device eth1976gitlab # [ 8.880419] systemd[1]: Starting Redis Server - redis-gitlab...977gitlab # [ 8.882546] systemd[1]: Starting Permit User Sessions...978gitlab # [ 8.895888] systemd[1]: Finished Permit User Sessions.979gitlab # [ 8.902603] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.980gitlab # [ 8.908821] systemd[1]: Started Getty on tty1.981gitlab # [ 8.910085] systemd[1]: Reached target Login Prompts.982gitlab # [ 9.220343] cfg80211: Loading compiled-in X.509 certificates for regulatory database983gitlab # [ 9.227589] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'984gitlab # [ 9.229639] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'985gitlab # [ 9.233086] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2986gitlab # [ 9.234814] cfg80211: failed to load regulatory.db987gitlab # [ 9.266899] 8021q: adding VLAN 0 to HW filter on device eth0988gitlab # [ 9.016311] dhcpcd[1224]: eth0: waiting for carrier989gitlab # [ 9.018387] dhcpcd[1224]: eth0: carrier acquired990gitlab # [ 9.027547] dhcpcd[1224]: DUID 00:01:00:01:31:de:42:2b:52:54:00:12:34:56991gitlab # [ 9.028731] dhcpcd[1224]: eth0: IAID 00:12:34:56992gitlab # [ 9.029780] dhcpcd[1224]: eth0: adding address fe80::5054:ff:fe12:3456993gitlab # [ 9.033812] redis-server[1247]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.994gitlab # [ 9.034947] systemd[1]: Started Redis Server - redis-gitlab.995gitlab # [ 9.036118] nginx-pre-start[1248]: nginx: the configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf syntax is ok996gitlab # [ 9.036973] nginx-pre-start[1248]: nginx: configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf test is successful997gitlab # [ 9.038274] redis-server[1247]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo998gitlab # [ 9.039166] redis-server[1247]: Redis version=8.8.0, bits=64, commit=00000000, modified=0, pid=1247, just started999gitlab # [ 9.039989] redis-server[1247]: Configuration loaded1000gitlab # [ 9.040931] redis[1247]: monotonic clock: POSIX clock_gettime1001gitlab # [ 9.042163] redis[1247]: Running mode=standalone, port=0.1002gitlab # [ 9.043087] redis[1247]: Server initialized1003gitlab # [ 9.043850] redis[1247]: Ready to accept connections unix1004gitlab # [ 9.045168] redis[1247]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1005gitlab # [ 9.059634] systemd[1]: Started Nginx Web Server.1006gitlab # [ 9.081614] postgresql-pre-start[1253]: The files belonging to this database system will be owned by user "postgres".1007gitlab # [ 9.083338] postgresql-pre-start[1253]: This user must also own the server process.1008gitlab # [ 9.085919] postgresql-pre-start[1253]: The database cluster will be initialized with locale "en_US.UTF-8".1009gitlab # [ 9.087191] postgresql-pre-start[1253]: The default database encoding has accordingly been set to "UTF8".1010gitlab # [ 9.087997] postgresql-pre-start[1253]: The default text search configuration will be set to "english".1011gitlab # [ 9.088851] postgresql-pre-start[1253]: Data page checksums are disabled.1012gitlab # [ 9.091229] postgresql-pre-start[1253]: fixing permissions on existing directory /var/lib/postgresql/17 ... ok1013gitlab # [ 9.092101] postgresql-pre-start[1253]: creating subdirectories ... ok1014gitlab # [ 9.092696] postgresql-pre-start[1253]: selecting dynamic shared memory implementation ... posix1015gitlab # [ 9.125680] postgresql-pre-start[1253]: selecting default "max_connections" ... 1001016gitlab # [ 9.159490] postgresql-pre-start[1253]: selecting default "shared_buffers" ... 128MB1017gitlab # [ 9.375460] systemd[1]: Started gitlab-workhorse.service.1018gitlab # [ 9.537659] postgresql-pre-start[1253]: selecting default time zone ... UTC1019gitlab # [ 9.542903] postgresql-pre-start[1253]: creating configuration files ... ok1020gitlab # [ 9.594417] gitlab-workhorse[1283]: time="2026-07-06T10:38:36Z" level=info msg=Starting build_time=19700101.000000 version=18.11.41021gitlab # [ 9.598356] gitlab-workhorse[1283]: time="2026-07-06T10:38:36Z" level=info msg="Using redis/go-redis"1022gitlab # [ 9.604242] gitlab-workhorse[1283]: time="2026-07-06T10:38:36Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1023gitlab # [ 9.719469] postgresql-pre-start[1253]: running bootstrap script ... ok1024gitlab # [ 10.167383] postgresql-pre-start[1253]: performing post-bootstrap initialization ... ok1025gitlab # [ 10.387363] dhcpcd[1224]: eth0: soliciting a DHCP lease1026gitlab # [ 10.651537] NET: Registered PF_PACKET protocol family1027gitlab # [ 10.405453] dhcpcd[1224]: eth0: offered 10.0.2.15 from 10.0.2.21028gitlab # [ 10.411112] dhcpcd[1224]: eth0: probing address 10.0.2.15/241029gitlab # [ 10.483419] postgresql-pre-start[1253]: syncing data to disk ... ok1030gitlab # [ 10.486391] postgresql-pre-start[1253]: initdb: warning: enabling "trust" authentication for local connections1031gitlab # [ 10.487835] postgresql-pre-start[1253]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1032gitlab # [ 10.490685] postgresql-pre-start[1253]: Success. You can now start the database server using:1033gitlab # [ 10.492744] postgresql-pre-start[1253]: pg_ctl -D /var/lib/postgresql/17 -l logfile start1034gitlab # [ 10.611062] postgres[1310]: [1310] LOG: starting PostgreSQL 17.10 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1035gitlab # [ 10.617459] postgres[1310]: [1310] LOG: listening on IPv6 address "::1", port 54321036gitlab # [ 10.620048] postgres[1310]: [1310] LOG: listening on IPv4 address "127.0.0.1", port 54321037gitlab # [ 10.629918] postgres[1310]: [1310] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1038gitlab # [ 10.651113] postgres[1317]: [1317] LOG: database system was shut down at 2026-07-06 10:38:37 GMT1039gitlab # [ 10.664328] postgres[1310]: [1310] LOG: database system is ready to accept connections1040gitlab # [ 10.670606] systemd[1]: Started PostgreSQL Server.1041gitlab # [ 10.673536] systemd[1]: Starting PostgreSQL Setup Scripts...1042gitlab # [ 10.833923] postgresql-setup-start[1328]: CREATE DATABASE1043gitlab # [ 10.871384] postgresql-setup-start[1342]: CREATE ROLE1044gitlab # [ 10.892316] postgresql-setup-start[1344]: ALTER DATABASE1045gitlab # [ 10.926843] postgresql-setup-start[1349]: CREATE ROLE1046gitlab # [ 10.932190] systemd[1]: Finished PostgreSQL Setup Scripts.1047gitlab # [ 10.933601] systemd[1]: Reached target PostgreSQL.1048gitlab # [ 10.935916] systemd[1]: Starting gitlab-postgresql.service...1049gitlab # [ 11.067406] gitlab-postgresql-start[1357]: CREATE DATABASE1050gitlab # [ 11.130884] gitlab-postgresql-start[1366]: CREATE EXTENSION1051gitlab # [ 11.178145] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1362]: mkdir -p /var/gitlab/state/home/.ssh: OK1052gitlab # [ 11.180724] gitlab-postgresql-start[1368]: CREATE EXTENSION1053gitlab # [ 11.182172] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1362]: chmod 700 /var/gitlab/state/home/.ssh: OK1054gitlab # [ 11.186885] systemd[1]: Finished gitlab-postgresql.service.1055gitlab # [ 11.226966] systemd[1]: Finished gitlab-config.service.1056gitlab # [ 11.232364] systemd[1]: Started gitaly.service.1057gitlab # [ 11.235308] systemd[1]: Starting gitlab-db-config.service...1058gitlab # [ 11.824048] gitaly[1383]: time="2026-07-06T10:38:38.718Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/2wcq0nlg508fs5wq7jnpg1lw2pib950g-gitaly.toml' and fix the errors that are printed." pid=13831059gitlab # [ 11.825404] gitaly[1383]: time="2026-07-06T10:38:38.718Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=13831060gitlab # [ 11.827081] gitaly[1383]: time="2026-07-06T10:38:38.718Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=13831061gitlab # [ 11.827926] gitaly[1383]: time="2026-07-06T10:38:38.718Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=13831062gitlab # [ 11.829377] gitaly[1383]: time="2026-07-06T10:38:38.718Z" level=info msg="Starting Gitaly" pid=1383 version=18.11.41063gitlab # [ 12.016230] dhcpcd[1224]: eth0: soliciting an IPv6 router1064gitlab # [ 12.017549] dhcpcd[1224]: eth0: Router Advertisement from fe80::21065gitlab # [ 12.018514] dhcpcd[1224]: eth0: adding address fec0::5054:ff:fe12:3456/641066gitlab # [ 12.019451] dhcpcd[1224]: eth0: adding route to fec0::/641067gitlab # [ 12.020268] dhcpcd[1224]: eth0: adding default route via fe80::21068gitlab # [ 12.057488] gitaly[1383]: time="2026-07-06T10:38:38.952Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=214 pid=13831069gitlab # [ 12.059469] gitaly[1383]: time="2026-07-06T10:38:38.954Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=13831070gitlab # [ 12.061082] gitaly[1383]: time="2026-07-06T10:38:38.954Z" level=info msg="finished initializing command factory" duration_ms=0 pid=13831071gitlab # [ 12.062450] gitaly[1383]: time="2026-07-06T10:38:38.954Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-1383/git-exec-3504375761.d/git pid=13831072gitlab # [ 12.069848] gitaly[1383]: time="2026-07-06T10:38:38.964Z" level=info msg="finished detecting git version" duration_ms=9 pid=13831073gitlab # [ 12.070870] gitaly[1383]: time="2026-07-06T10:38:38.965Z" level=info msg="using Git version" pid=1383 version=2.53.g1074gitlab # [ 12.075693] gitaly[1383]: time="2026-07-06T10:38:38.970Z" level=info msg="clearing disk cache object folder" pid=1383 storage=default1075gitlab # [ 12.078666] gitaly[1383]: time="2026-07-06T10:38:38.973Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2347328411 pid=1383 storage=default1076gitlab # [ 12.079651] gitaly[1383]: time="2026-07-06T10:38:38.973Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2347328411 pid=1383 storage=default1077gitlab # [ 12.080907] gitaly[1383]: time="2026-07-06T10:38:38.974Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2347328411 clear_duration_ms=0 pid=1383 storage=default1078gitlab # [ 12.092293] gitaly[1383]: time="2026-07-06T10:38:38.987Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=13831079gitlab # [ 12.097399] gitaly[1383]: time="2026-07-06T10:38:38.987Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=13831080gitlab # [ 12.165988] gitaly[1383]: time="2026-07-06T10:38:39.060Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=13831081gitlab # [ 12.168440] gitaly[1383]: time="2026-07-06T10:38:39.060Z" level=info msg="counting repositories" pid=13831082gitlab # [ 12.170452] gitaly[1383]: time="2026-07-06T10:38:39.061Z" level=info msg="finished tempdir cleaner walk" pid=1383 storage=default time_ms=01083gitlab # [ 12.172563] gitaly[1383]: time="2026-07-06T10:38:39.061Z" level=info msg="starting to count repositories" pid=1383 storage_path=/var/gitlab/state/repositories1084gitlab # [ 12.173545] gitaly[1383]: time="2026-07-06T10:38:39.060Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=1383 schema=unix1085gitlab # [ 12.176610] gitaly[1383]: time="2026-07-06T10:38:39.071Z" level=info msg="listening at address" address=/run/gitaly/gitaly-1383/sock.d/intern pid=1383 schema=unix1086gitlab # [ 12.190435] gitaly[1383]: time="2026-07-06T10:38:39.085Z" level=info msg="completed counting repositories" counting_duration_ms=24 pid=1383 storage_path=/var/gitlab/state/repositories1087gitlab # [ 12.192230] gitaly[1383]: time="2026-07-06T10:38:39.085Z" level=info msg="completed counting all repositories" counting_duration=24 pid=13831088gitlab # [ 12.193384] gitaly[1383]: time="2026-07-06T10:38:39.086Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=13831089gitlab # [ 12.194804] gitaly[1383]: time="2026-07-06T10:38:39.086Z" level=info msg="Started Gitaly" duration_ms=367 pid=13831090gitlab # [ 12.196334] gitaly[1383]: time="2026-07-06T10:38:39.087Z" level=info msg="maintenance: daily scheduled" pid=1383 scheduled="2026-07-06 12:00:00 +0000 UTC"1091gitlab # [ 12.677953] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1386]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1092gitlab # [ 12.682278] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1386]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1093gitlab # [ 12.703986] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1386]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1094gitlab # [ 14.108379] gitaly[1383]: time="2026-07-06T10:38:41.002Z" level=info msg="License database preloaded" duration_ms=2283 pid=13831095gitlab # [ 15.532446] dhcpcd[1224]: eth0: leased 10.0.2.15 for 86400 seconds1096gitlab # [ 15.535809] dhcpcd[1224]: eth0: adding route to 10.0.2.0/241097gitlab # [ 15.538993] dhcpcd[1224]: eth0: adding default route via 10.0.2.21098gitlab # [ 15.674144] systemd[1]: Started DHCP Client.1099gitlab # [ 15.678556] systemd[1]: Reached target Network is Online.1100gitlab # [ 43.366700] postgres[1741]: [1741] ERROR: relation "feature_gates" does not exist at character 5231101gitlab # [ 43.372715] postgres[1741]: [1741] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1102gitlab # [ 43.377921] postgres[1741]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1103gitlab # [ 43.383534] postgres[1741]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1104gitlab # [ 43.388669] postgres[1741]: attidentity AS identity,1105gitlab # [ 43.392289] postgres[1741]: attgenerated as attgenerated1106gitlab # [ 43.396534] postgres[1741]: FROM pg_attribute a1107gitlab # [ 43.399943] postgres[1741]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1108gitlab # [ 43.405598] postgres[1741]: LEFT JOIN pg_type t ON a.atttypid = t.oid1109gitlab # [ 43.409727] postgres[1741]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1110gitlab # [ 43.415941] postgres[1741]: WHERE a.attrelid = '"feature_gates"'::regclass1111gitlab # [ 43.420092] postgres[1741]: AND a.attnum > 0 AND NOT a.attisdropped1112gitlab # [ 43.423333] postgres[1741]: ORDER BY a.attnum1113gitlab # [ 43.425726] postgres[1741]:1114gitlab # [ 43.588234] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1386]: W, [2026-07-06T10:39:10.482369 #1386] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1115gitlab # [ 49.287831] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1805]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1116gitlab # [ 49.296198] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1805]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1117gitlab # [ 49.669788] gitlab-workhorse[1283]: time="2026-07-06T10:39:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1118gitlab # [ 59.681535] gitlab-workhorse[1283]: time="2026-07-06T10:39:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 66.489914] postgres[1880]: [1880] ERROR: relation "table_without_models" does not exist1120gitlab # [ 66.493864] postgres[1880]: [1880] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1121gitlab # [ 69.692138] gitlab-workhorse[1283]: time="2026-07-06T10:39:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 79.702435] gitlab-workhorse[1283]: time="2026-07-06T10:39:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1123gitlab # [ 81.677239] systemd[1]: Finished gitlab-db-config.service.1124gitlab # [ 81.684944] systemd[1]: Started gitlab-sidekiq.service.1125gitlab # [ 81.692111] systemd[1]: Starting gitlab.service...1126gitlab # [ 82.045245] bundle[2083]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1127gitlab # [ 82.047237] bundle[2083]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1128gitlab # [ 82.049203] bundle[2083]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1129gitlab # [ 84.943417] sidekiq-cluster[2082]: {"severity":"INFO","time":"2026-07-06T10:39:51.820Z","message":"Starting cluster with 1 processes"}1130gitlab # [ 85.084759] bundle[2083]: {"timestamp":"2026-07-06T10:39:51.957Z","pid":2083,"message":"* Enabling systemd notification integration"}1131gitlab # [ 85.087396] bundle[2083]: {"timestamp":"2026-07-06T10:39:51.978Z","pid":2083,"message":"Puma starting in cluster mode..."}1132gitlab # [ 85.090862] bundle[2083]: {"timestamp":"2026-07-06T10:39:51.979Z","pid":2083,"message":"* Puma version: 7.2.0 (\"On The Corner\")"}1133gitlab # [ 85.094712] bundle[2083]: {"timestamp":"2026-07-06T10:39:51.979Z","pid":2083,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1134gitlab # [ 85.097154] bundle[2083]: {"timestamp":"2026-07-06T10:39:51.979Z","pid":2083,"message":"* Min threads: 0"}1135gitlab # [ 85.101150] bundle[2083]: {"timestamp":"2026-07-06T10:39:51.979Z","pid":2083,"message":"* Max threads: 4"}1136gitlab # [ 85.104603] bundle[2083]: {"timestamp":"2026-07-06T10:39:51.979Z","pid":2083,"message":"* Environment: production"}1137gitlab # [ 85.107236] bundle[2083]: {"timestamp":"2026-07-06T10:39:51.979Z","pid":2083,"message":"* Master PID: 2083"}1138gitlab # [ 85.109290] bundle[2083]: {"timestamp":"2026-07-06T10:39:51.979Z","pid":2083,"message":"* Workers: 2"}1139gitlab # [ 85.111930] bundle[2083]: {"timestamp":"2026-07-06T10:39:51.979Z","pid":2083,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1140gitlab # [ 85.113945] bundle[2083]: {"timestamp":"2026-07-06T10:39:51.979Z","pid":2083,"message":"* Preloading application"}1141gitlab # [ 89.704732] gitlab-workhorse[1283]: time="2026-07-06T10:39:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 99.719593] gitlab-workhorse[1283]: time="2026-07-06T10:40:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 109.729466] gitlab-workhorse[1283]: time="2026-07-06T10:40:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 111.742499] bundle[2083]: W, [2026-07-06T10:40:18.636630 #2083] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1145gitlab # [ 112.649399] sidekiq-cluster[2114]: 2026-07-06T10:40:19.543Z pid=2114 tid=tze INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2114, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430444544}1146gitlab # [ 112.842127] sidekiq-cluster[2114]: W, [2026-07-06T10:40:19.736871 #2114] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1147gitlab # [ 112.890137] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:19.783Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1148gitlab # [ 115.118671] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.012Z","message":"GitLab reliable fetch activated!"}1149gitlab # [ 115.125467] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.012Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1150gitlab # [ 115.150458] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.045Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1151gitlab # [ 115.160178] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.052Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1152gitlab # [ 115.171371] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.066Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1153gitlab # [ 115.178931] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.070Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1154gitlab # [ 115.187880] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.082Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1155gitlab # [ 115.200110] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.095Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1156gitlab # [ 115.210096] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.105Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1157gitlab # [ 115.218095] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.113Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1158gitlab # [ 115.226072] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.121Z","message":"Cron Jobs - added job with name expire_build_artifacts_worker in the namespace default"}1159gitlab # [ 115.234105] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.129Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1160gitlab # [ 115.242520] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.137Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1161gitlab # [ 115.252081] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.147Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1162gitlab # [ 115.260567] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.155Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1163gitlab # [ 115.269139] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.164Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1164gitlab # [ 115.277804] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.172Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1165gitlab # [ 115.286574] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.181Z","message":"Cron Jobs - added job with name environments_auto_delete_cron_worker in the namespace default"}1166gitlab # [ 115.295635] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.190Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1167gitlab # [ 115.305934] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.200Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1168gitlab # [ 115.316217] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.211Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1169gitlab # [ 115.326165] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.220Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1170gitlab # [ 115.338921] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.233Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1171gitlab # [ 115.346211] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.241Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1172gitlab # [ 115.356142] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.251Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1173gitlab # [ 115.365505] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.260Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1174gitlab # [ 115.375610] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.270Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1175gitlab # [ 115.384579] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.279Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1176gitlab # [ 115.394589] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.289Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1177gitlab # [ 115.404424] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.299Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1178gitlab # [ 115.414238] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.309Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1179gitlab # [ 115.424394] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.319Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1180gitlab # [ 115.436526] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.331Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1181gitlab # [ 115.446430] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.341Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1182gitlab # [ 115.456624] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.351Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1183gitlab # [ 115.466214] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.361Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1184gitlab # [ 115.476214] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.371Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1185gitlab # [ 115.485207] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.380Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1186gitlab # [ 115.494102] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.388Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1187gitlab # [ 115.502871] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.397Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1188gitlab # [ 115.512128] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.406Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1189gitlab # [ 115.520800] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.415Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1190gitlab # [ 115.529472] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.424Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1191gitlab # [ 115.538508] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.433Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1192gitlab # [ 115.547202] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.442Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1193gitlab # [ 115.556160] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.451Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1194gitlab # [ 115.565242] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.460Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1195gitlab # [ 115.575386] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.470Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1196gitlab # [ 115.585195] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.480Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1197gitlab # [ 115.593578] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.488Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1198gitlab # [ 115.604739] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.499Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1199gitlab # [ 115.615751] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.510Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1200gitlab # [ 115.624391] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.519Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1201gitlab # [ 115.633567] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.528Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1202gitlab # [ 115.643089] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.538Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1203gitlab # [ 115.666182] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.561Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1204gitlab # [ 115.674905] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.569Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1205gitlab # [ 115.682996] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.578Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1206gitlab # [ 115.690937] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.585Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1207gitlab # [ 115.700418] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.595Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1208gitlab # [ 115.709505] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.604Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1209gitlab # [ 115.717653] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.612Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1210gitlab # [ 115.725265] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.620Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1211gitlab # [ 115.734828] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.629Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1212gitlab # [ 115.741931] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.636Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1213gitlab # [ 115.750686] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.645Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1214gitlab # [ 115.761166] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.656Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1215gitlab # [ 115.770603] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.665Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1216gitlab # [ 115.781341] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.676Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1217gitlab # [ 115.790211] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.685Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1218gitlab # [ 115.799241] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.694Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1219gitlab # [ 115.808230] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.703Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1220gitlab # [ 115.847787] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.742Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1221gitlab # [ 115.861408] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.756Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1222gitlab # [ 115.873087] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.768Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1223gitlab # [ 115.886319] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.781Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1224gitlab # [ 115.901270] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.796Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1225gitlab # [ 115.914787] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.809Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1226gitlab # [ 115.930739] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.825Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1227gitlab # [ 115.944961] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.839Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1228gitlab # [ 115.959993] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.854Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1229gitlab # [ 115.999252] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.894Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1230gitlab # [ 116.012108] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.907Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1231gitlab # [ 116.023969] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.919Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1232gitlab # [ 116.035912] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.930Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1233gitlab # [ 116.049707] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.944Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1234gitlab # [ 116.058080] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.953Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1235gitlab # [ 116.062074] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.956Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1236gitlab # [ 116.065767] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.958Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1237gitlab # [ 116.069751] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.961Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1238gitlab # [ 116.073542] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.964Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1239gitlab # [ 116.077445] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.967Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1240gitlab # [ 116.081233] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.969Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1241gitlab # [ 116.085199] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.972Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1242gitlab # [ 116.088989] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.974Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1243gitlab # [ 116.093593] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.977Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1244gitlab # [ 116.097613] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.980Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1245gitlab # [ 116.100938] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.983Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1246gitlab # [ 116.104889] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.986Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1247gitlab # [ 116.109109] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.988Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1248gitlab # [ 116.112924] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:22.991Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1249gitlab # [ 116.116885] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:23.004Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1250gitlab # [ 116.118241] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:23.007Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1251gitlab # [ 116.118976] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:23.009Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1252gitlab # [ 116.129669] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:23.024Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1253gitlab # [ 116.135877] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:23.031Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1254gitlab # [ 116.142546] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:23.037Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1255gitlab # [ 116.148998] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:23.044Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1256gitlab # [ 116.155560] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:23.050Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1257gitlab # [ 116.161354] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:23.056Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1258gitlab # [ 116.168476] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:23.063Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1259gitlab # [ 116.174363] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:23.069Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1260gitlab # [ 119.739713] gitlab-workhorse[1283]: time="2026-07-06T10:40:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1261gitlab # [ 129.742452] gitlab-workhorse[1283]: time="2026-07-06T10:40:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1262gitlab # [ 138.759623] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:45.653Z","message":"Booted Rails 7.2.3 application in production environment"}1263gitlab # [ 138.767578] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:45.654Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1264gitlab # [ 138.775795] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:45.654Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1265gitlab # [ 138.783358] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:45.654Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1266gitlab # [ 138.791575] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:45.657Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1267gitlab # [ 139.744822] gitlab-workhorse[1283]: time="2026-07-06T10:40:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1268gitlab # [ 140.301659] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:47.195Z","message":"Cleaning working queues"}1269gitlab # [ 140.309507] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:47.204Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"a28d58b55c5b02b18f633fbc","created_at":"2026-07-06T10:39:48.003Z","trace_propagation_headers":{"sentry-trace":"cf4b7fd7aba34a3fb30fb032ae2e759a-732394d70cf54f36","baggage":"sentry-trace_id=cf4b7fd7aba34a3fb30fb032ae2e759a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"9faffee9fb618a5ef54beb8f094105a3","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-06T10:39:48.013Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-a28d58b55c5b02b18f633fbc: start","job_status":"start","queue_duration_s":59.190227,"scheduling_latency_s":59.190287}1270gitlab # [ 140.580859] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:40:47.475Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"a28d58b55c5b02b18f633fbc","created_at":"2026-07-06T10:39:48.003Z","trace_propagation_headers":{"sentry-trace":"cf4b7fd7aba34a3fb30fb032ae2e759a-732394d70cf54f36","baggage":"sentry-trace_id=cf4b7fd7aba34a3fb30fb032ae2e759a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"9faffee9fb618a5ef54beb8f094105a3","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-06T10:39:48.013Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-a28d58b55c5b02b18f633fbc: done: 0.271509 sec","job_status":"done","queue_duration_s":59.190227,"scheduling_latency_s":59.190287,"redis_calls":31,"redis_duration_s":0.01443,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.009684,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00255,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002196,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.093546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.111983505,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.271509,"completed_at":"2026-07-06T10:40:47.475Z","load_balancing_strategy":"primary","db_duration_s":0.086814,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1271gitlab # [ 140.884565] bundle[2083]: {"timestamp":"2026-07-06T10:40:47.778Z","pid":2083,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1272gitlab # [ 140.887824] bundle[2083]: {"timestamp":"2026-07-06T10:40:47.778Z","pid":2083,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1273gitlab # [ 140.891403] bundle[2083]: {"timestamp":"2026-07-06T10:40:47.778Z","pid":2083,"message":"! #\u003cThread:0x00007ae2e8d12928 /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1274gitlab # [ 140.893969] bundle[2083]: {"timestamp":"2026-07-06T10:40:47.779Z","pid":2083,"message":"! #\u003cThread:0x00007ae2e8f533e0 /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1275gitlab # [ 140.897208] bundle[2083]: {"timestamp":"2026-07-06T10:40:47.779Z","pid":2083,"message":"Use Ctrl-C to stop"}1276gitlab # [ 140.899878] bundle[2083]: {"timestamp":"2026-07-06T10:40:47.779Z","pid":2083,"message":"Sending status to systemd every 1.0 sec"}1277gitlab # [ 141.298625] bundle[2083]: {"timestamp":"2026-07-06T10:40:48.193Z","pid":2083,"message":"- Worker 0 (PID: 2660) booted in 0.35s, phase: 0"}1278gitlab # [ 141.317626] bundle[2083]: {"timestamp":"2026-07-06T10:40:48.212Z","pid":2083,"message":"- Worker 1 (PID: 2664) booted in 0.35s, phase: 0"}1279gitlab # [ 141.326927] systemd[1]: Started gitlab.service.1280gitlab # [ 141.329777] systemd[1]: Reached target Common target for all GitLab services..1281gitlab # [ 141.333348] systemd[1]: Starting setup-gitlab.service...1282gitlab # [ 141.360426] setup-gitlab-start[2688]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1283gitlab # [ 143.823697] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:40:50 +0000] "GET /users/sign_in HTTP/1.1" 200 10624 "" "curl/8.20.0" 24311284gitlab # [ 143.836858] setup-gitlab-start[2711]: ++ curl -fs -X POST -H 'Content-Type: application/json' -d '{"grant_type":"password","username":"root","password":"notproduction"}' http://gitlab/oauth/token1285gitlab # [ 143.838418] setup-gitlab-start[2712]: ++ jq -r .access_token1286gitlab # [ 145.181525] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:40:52 +0000] "POST /oauth/token HTTP/1.1" 200 244 "" "curl/8.20.0" 13191287gitlab # [ 145.191722] setup-gitlab-start[2688]: + BEARER=5c9276642be34de0e1ba559254c41649e929b8983013bed8e840be47c4271c831288gitlab # [ 145.197439] setup-gitlab-start[2688]: + AUTH='Authorization: Bearer 5c9276642be34de0e1ba559254c41649e929b8983013bed8e840be47c4271c83'1289gitlab # [ 145.203915] setup-gitlab-start[2688]: + curl -fs -X PUT -H 'Authorization: Bearer 5c9276642be34de0e1ba559254c41649e929b8983013bed8e840be47c4271c83' 'http://gitlab/api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true'1290gitlab # [ 146.001348] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:40:52 +0000] "PUT /api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true HTTP/1.1" 200 17133 "" "curl/8.20.0" 8051291gitlab # [ 146.006373] setup-gitlab-start[2688]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner Rails.cache.clear1292gitlab # [ 146.020486] runuser[2734]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1293gitlab # [ 146.380695] setup-gitlab-start[2735]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1294gitlab # [ 146.384238] setup-gitlab-start[2735]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1295gitlab # [ 146.387295] setup-gitlab-start[2735]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1296gitlab # [ 146.993400] setup-gitlab-start[2735]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1297gitlab # [ 146.996140] setup-gitlab-start[2735]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1298gitlab # [ 146.997977] setup-gitlab-start[2735]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1299gitlab # [ 154.958822] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:01.852Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6d51eeafa233cb621f52f33d","created_at":"2026-07-06T10:41:01.811Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c4e8042a48c872edb157b04c0d7c0b6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:01.847Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6d51eeafa233cb621f52f33d: start","job_status":"start","queue_duration_s":0.004768,"scheduling_latency_s":0.004837}1300gitlab # [ 154.978334] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:01.872Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1301gitlab # [ 154.991859] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:01.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6d51eeafa233cb621f52f33d","created_at":"2026-07-06T10:41:01.811Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c4e8042a48c872edb157b04c0d7c0b6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:01.847Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6d51eeafa233cb621f52f33d: done: 0.033784 sec","job_status":"done","queue_duration_s":0.004768,"scheduling_latency_s":0.004837,"redis_calls":10,"redis_duration_s":0.00447,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000993,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002622,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000855,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000704559,"duration_s":0.033784,"completed_at":"2026-07-06T10:41:01.886Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000793,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 155.103945] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:01.998Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"097f69406b4b88bced522677","created_at":"2026-07-06T10:41:01.990Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5abc6d33426d6cb3dd3fb4db9a0dad7f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:01.997Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-097f69406b4b88bced522677: start","job_status":"start","queue_duration_s":0.001771,"scheduling_latency_s":0.001804}1303gitlab # [ 155.886861] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.781Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"097f69406b4b88bced522677","created_at":"2026-07-06T10:41:01.990Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5abc6d33426d6cb3dd3fb4db9a0dad7f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:01.997Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-097f69406b4b88bced522677: done: 0.782683 sec","job_status":"done","queue_duration_s":0.001771,"scheduling_latency_s":0.001804,"redis_calls":574,"redis_duration_s":0.396413,"redis_read_bytes":573,"redis_write_bytes":49866,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001722,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004274,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.390417,"redis_shared_state_read_bytes":567,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.406858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000644495,"duration_s":0.782683,"completed_at":"2026-07-06T10:41:02.781Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002039,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 155.966597] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.783Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b5e7c3e33362c4c6debfa373","created_at":"2026-07-06T10:41:02.034Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed5cc50539ac7efa55f5f5c1fb920635","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.048Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b5e7c3e33362c4c6debfa373: start","job_status":"start","queue_duration_s":0.735163,"scheduling_latency_s":0.735186}1305gitlab # [ 155.988296] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b5e7c3e33362c4c6debfa373","created_at":"2026-07-06T10:41:02.034Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed5cc50539ac7efa55f5f5c1fb920635","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.048Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b5e7c3e33362c4c6debfa373: done: 0.023679 sec","job_status":"done","queue_duration_s":0.735163,"scheduling_latency_s":0.735186,"redis_calls":10,"redis_duration_s":0.004347,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000922,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002485,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000548953,"duration_s":0.023679,"completed_at":"2026-07-06T10:41:02.807Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 156.052267] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.809Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"35d623eb1e453b651bc89f8d","created_at":"2026-07-06T10:41:02.069Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b91758f3f6617a92a4735f8840c1b4fa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-06T10:41:02.083Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-35d623eb1e453b651bc89f8d: start","job_status":"start","queue_duration_s":0.726519,"scheduling_latency_s":0.726539}1307gitlab # [ 156.073282] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"35d623eb1e453b651bc89f8d","created_at":"2026-07-06T10:41:02.069Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b91758f3f6617a92a4735f8840c1b4fa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-06T10:41:02.083Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-35d623eb1e453b651bc89f8d: done: 0.026956 sec","job_status":"done","queue_duration_s":0.726519,"scheduling_latency_s":0.726539,"redis_calls":10,"redis_duration_s":0.003916,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00075,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002428,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000738,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000496432,"duration_s":0.026956,"completed_at":"2026-07-06T10:41:02.836Z","load_balancing_strategy":"primary","db_duration_s":0.002354,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 156.076232] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f647c1d09189682618230c3e","created_at":"2026-07-06T10:41:02.097Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0505e3ec4c408db6e9a91ea21d921512","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.111Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f647c1d09189682618230c3e: start","job_status":"start","queue_duration_s":0.72763,"scheduling_latency_s":0.727651}1309gitlab # [ 156.091534] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.850Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1310gitlab # [ 156.097297] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.857Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f647c1d09189682618230c3e","created_at":"2026-07-06T10:41:02.097Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0505e3ec4c408db6e9a91ea21d921512","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.111Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f647c1d09189682618230c3e: done: 0.019109 sec","job_status":"done","queue_duration_s":0.72763,"scheduling_latency_s":0.727651,"redis_calls":10,"redis_duration_s":0.004254,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000837,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002589,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000828,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000502578,"duration_s":0.019109,"completed_at":"2026-07-06T10:41:02.857Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000406,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 156.180462] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"a4856f98673997458ecef967","created_at":"2026-07-06T10:41:02.123Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99632be0ca0cc54858da80abd8c9a307","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.135Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-a4856f98673997458ecef967: start","job_status":"start","queue_duration_s":0.724419,"scheduling_latency_s":0.724438}1312gitlab # [ 156.184617] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.871Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1313gitlab # [ 156.190727] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.878Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"a4856f98673997458ecef967","created_at":"2026-07-06T10:41:02.123Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99632be0ca0cc54858da80abd8c9a307","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.135Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-a4856f98673997458ecef967: done: 0.018403 sec","job_status":"done","queue_duration_s":0.724419,"scheduling_latency_s":0.724438,"redis_calls":10,"redis_duration_s":0.004086,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000827,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00237,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000889,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052828,"duration_s":0.018403,"completed_at":"2026-07-06T10:41:02.878Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000344,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 156.283935] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.880Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"bfb05c83d30bdb42ebf0d862","created_at":"2026-07-06T10:41:02.158Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0cfd3f7d2bc46f39ca21f9d544a548c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.170Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-bfb05c83d30bdb42ebf0d862: start","job_status":"start","queue_duration_s":0.709649,"scheduling_latency_s":0.70967}1315gitlab # [ 156.284914] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.891Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1316gitlab # [ 156.286144] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.898Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"bfb05c83d30bdb42ebf0d862","created_at":"2026-07-06T10:41:02.158Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0cfd3f7d2bc46f39ca21f9d544a548c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.170Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-bfb05c83d30bdb42ebf0d862: done: 0.018854 sec","job_status":"done","queue_duration_s":0.709649,"scheduling_latency_s":0.70967,"redis_calls":10,"redis_duration_s":0.004181,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000907,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00252,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000754,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050146,"duration_s":0.018854,"completed_at":"2026-07-06T10:41:02.898Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000325,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 156.354934] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.900Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"28e73a7d1585b20bbaef287c","created_at":"2026-07-06T10:41:02.182Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfdbaf1052d4021a99178efb4b767771","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.192Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-28e73a7d1585b20bbaef287c: start","job_status":"start","queue_duration_s":0.708111,"scheduling_latency_s":0.708132}1318gitlab # [ 156.369076] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.925Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"28e73a7d1585b20bbaef287c","created_at":"2026-07-06T10:41:02.182Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfdbaf1052d4021a99178efb4b767771","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.192Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-28e73a7d1585b20bbaef287c: done: 0.024596 sec","job_status":"done","queue_duration_s":0.708111,"scheduling_latency_s":0.708132,"redis_calls":12,"redis_duration_s":0.00504,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000817,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002494,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001729,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000720762,"exclusive_lock_hold_duration_s":0.00524955,"duration_s":0.024596,"completed_at":"2026-07-06T10:41:02.925Z","load_balancing_strategy":"primary","db_duration_s":0.002495,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 156.461191] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.927Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"15b743765fed953c7866a666","created_at":"2026-07-06T10:41:02.225Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4592c1468f8482bb529f5f0a9f3dd5f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.237Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-15b743765fed953c7866a666: start","job_status":"start","queue_duration_s":0.689225,"scheduling_latency_s":0.689246}1320gitlab # [ 156.462796] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"15b743765fed953c7866a666","created_at":"2026-07-06T10:41:02.225Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4592c1468f8482bb529f5f0a9f3dd5f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.237Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-15b743765fed953c7866a666: done: 0.032498 sec","job_status":"done","queue_duration_s":0.689225,"scheduling_latency_s":0.689246,"redis_calls":19,"redis_duration_s":0.007673,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001735,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000499,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004128,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001311,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000488889,"duration_s":0.032498,"completed_at":"2026-07-06T10:41:02.959Z","load_balancing_strategy":"primary","db_duration_s":0.001366,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 156.533290] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.961Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"23c16b95d2fcb657065d4caa","created_at":"2026-07-06T10:41:02.250Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"011ca4e8b8cc34216dbebe0724ff0f60","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-06T10:41:02.260Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-23c16b95d2fcb657065d4caa: start","job_status":"start","queue_duration_s":0.701374,"scheduling_latency_s":0.701394}1322gitlab # [ 156.536654] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.976Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1323gitlab # [ 156.603335] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.982Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"23c16b95d2fcb657065d4caa","created_at":"2026-07-06T10:41:02.250Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"011ca4e8b8cc34216dbebe0724ff0f60","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-06T10:41:02.260Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-23c16b95d2fcb657065d4caa: done: 0.020897 sec","job_status":"done","queue_duration_s":0.701374,"scheduling_latency_s":0.701394,"redis_calls":10,"redis_duration_s":0.002407,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000471,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000356749,"duration_s":0.020897,"completed_at":"2026-07-06T10:41:02.982Z","load_balancing_strategy":"primary","db_duration_s":0.000383,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 156.605244] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:02.983Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"694411cf6e36e67c584746f2","created_at":"2026-07-06T10:41:02.271Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3a42cbe8c279459a845dd2667374314","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.283Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-694411cf6e36e67c584746f2: start","job_status":"start","queue_duration_s":0.70034,"scheduling_latency_s":0.70036}1325gitlab # [ 156.686367] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.011Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"694411cf6e36e67c584746f2","created_at":"2026-07-06T10:41:02.271Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3a42cbe8c279459a845dd2667374314","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.283Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-694411cf6e36e67c584746f2: done: 0.027202 sec","job_status":"done","queue_duration_s":0.70034,"scheduling_latency_s":0.70036,"redis_calls":13,"redis_duration_s":0.003143,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000494,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001673,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008908674,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.027202,"completed_at":"2026-07-06T10:41:03.011Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002752,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1326gitlab # [ 156.693057] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.012Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b91411f3930bcbc5c170ad72","created_at":"2026-07-06T10:41:02.293Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb809151bc9ac609099c3692d982d3c4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.299Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b91411f3930bcbc5c170ad72: start","job_status":"start","queue_duration_s":0.712828,"scheduling_latency_s":0.71285}1327gitlab # [ 156.768323] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.283Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b91411f3930bcbc5c170ad72","created_at":"2026-07-06T10:41:02.293Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb809151bc9ac609099c3692d982d3c4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.299Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b91411f3930bcbc5c170ad72: done: 0.270504 sec","job_status":"done","queue_duration_s":0.712828,"scheduling_latency_s":0.71285,"redis_calls":14,"redis_duration_s":0.003499,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000972,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001371,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001156,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.06,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.059,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.182653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000493079,"exclusive_lock_hold_duration_s":0.249504056,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.270504,"completed_at":"2026-07-06T10:41:03.283Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.064577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 156.783053] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.284Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"039474abe0a69476e9d82acd","created_at":"2026-07-06T10:41:02.305Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba8ed5cf96e68b4f97bfa3efe434557c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.312Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-039474abe0a69476e9d82acd: start","job_status":"start","queue_duration_s":0.971825,"scheduling_latency_s":0.971847}1329gitlab # [ 156.805806] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.309Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"039474abe0a69476e9d82acd","created_at":"2026-07-06T10:41:02.305Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba8ed5cf96e68b4f97bfa3efe434557c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.312Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-039474abe0a69476e9d82acd: done: 0.025023 sec","job_status":"done","queue_duration_s":0.971825,"scheduling_latency_s":0.971847,"redis_calls":12,"redis_duration_s":0.002846,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000431,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001382,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000470171,"exclusive_lock_hold_duration_s":0.0058596839999999996,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.025023,"completed_at":"2026-07-06T10:41:03.309Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002401,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 156.886996] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.311Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"bf4481e9cbfd6ea2c5daf4d2","created_at":"2026-07-06T10:41:02.323Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fa175c97aab23262f64394cc27e2cfa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-06T10:41:02.329Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-bf4481e9cbfd6ea2c5daf4d2: start","job_status":"start","queue_duration_s":0.981491,"scheduling_latency_s":0.981513}1331gitlab # [ 156.891347] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.322Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1332gitlab # [ 156.959395] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.327Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"bf4481e9cbfd6ea2c5daf4d2","created_at":"2026-07-06T10:41:02.323Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fa175c97aab23262f64394cc27e2cfa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-06T10:41:02.329Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-bf4481e9cbfd6ea2c5daf4d2: done: 0.016463 sec","job_status":"done","queue_duration_s":0.981491,"scheduling_latency_s":0.981513,"redis_calls":10,"redis_duration_s":0.002211,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000457,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001326,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000428,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000376584,"duration_s":0.016463,"completed_at":"2026-07-06T10:41:03.327Z","load_balancing_strategy":"primary","db_duration_s":0.000366,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 156.961260] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"326eb9576239c73836d7444c","created_at":"2026-07-06T10:41:02.348Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3eef140a0e1ddb7878a5692ef3bf7c7","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.356Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-326eb9576239c73836d7444c: start","job_status":"start","queue_duration_s":0.972917,"scheduling_latency_s":0.972937}1334gitlab # [ 156.981379] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.354Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"326eb9576239c73836d7444c","created_at":"2026-07-06T10:41:02.348Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3eef140a0e1ddb7878a5692ef3bf7c7","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.356Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-326eb9576239c73836d7444c: done: 0.025057 sec","job_status":"done","queue_duration_s":0.972917,"scheduling_latency_s":0.972937,"redis_calls":10,"redis_duration_s":0.002304,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000485,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001343,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000476,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000345296,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.025057,"completed_at":"2026-07-06T10:41:03.354Z","load_balancing_strategy":"primary","db_duration_s":0.007809,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 157.052501] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.355Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"0726a4eeb8676fd678edb102","created_at":"2026-07-06T10:41:02.364Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d15bba9ba8444d61eedc7b12faa7f0a7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.371Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-0726a4eeb8676fd678edb102: start","job_status":"start","queue_duration_s":0.984432,"scheduling_latency_s":0.984453}1336gitlab # [ 157.068365] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.388Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"0726a4eeb8676fd678edb102","created_at":"2026-07-06T10:41:02.364Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d15bba9ba8444d61eedc7b12faa7f0a7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.371Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-0726a4eeb8676fd678edb102: done: 0.03316 sec","job_status":"done","queue_duration_s":0.984432,"scheduling_latency_s":0.984453,"redis_calls":12,"redis_duration_s":0.002859,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000493,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001354,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000535264,"exclusive_lock_hold_duration_s":0.009170161,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.03316,"completed_at":"2026-07-06T10:41:03.388Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010201,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 157.143187] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.390Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9ab7de92d4a243bb643785ad","created_at":"2026-07-06T10:41:02.377Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"573e0f1e56b9b0b47562ce01f54b4449","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.383Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9ab7de92d4a243bb643785ad: start","job_status":"start","queue_duration_s":1.006302,"scheduling_latency_s":1.006322}1338gitlab # [ 157.221437] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.409Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9ab7de92d4a243bb643785ad","created_at":"2026-07-06T10:41:02.377Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"573e0f1e56b9b0b47562ce01f54b4449","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.383Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9ab7de92d4a243bb643785ad: done: 0.019088 sec","job_status":"done","queue_duration_s":1.006302,"scheduling_latency_s":1.006322,"redis_calls":12,"redis_duration_s":0.002567,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00087,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001287,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00041,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000525485,"duration_s":0.019088,"completed_at":"2026-07-06T10:41:03.409Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000698,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 157.223209] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.410Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"0957cb5aaf6844c8cde382e4","created_at":"2026-07-06T10:41:02.402Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c136669a43a27cebf452d6f0a1c8ab04","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.410Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-0957cb5aaf6844c8cde382e4: start","job_status":"start","queue_duration_s":1.000626,"scheduling_latency_s":1.000646}1340gitlab # [ 157.245215] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.428Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"0957cb5aaf6844c8cde382e4","created_at":"2026-07-06T10:41:02.402Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c136669a43a27cebf452d6f0a1c8ab04","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.410Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-0957cb5aaf6844c8cde382e4: done: 0.017272 sec","job_status":"done","queue_duration_s":1.000626,"scheduling_latency_s":1.000646,"redis_calls":10,"redis_duration_s":0.002238,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000456,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001373,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000409,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003344,"duration_s":0.017272,"completed_at":"2026-07-06T10:41:03.427Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000356,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 157.313142] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.431Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"410196837ffb5a6f2d9e4815","created_at":"2026-07-06T10:41:02.417Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e2dd8de7dfb8477d9dbe06b2c1dba98","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.424Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-410196837ffb5a6f2d9e4815: start","job_status":"start","queue_duration_s":1.007354,"scheduling_latency_s":1.007376}1342gitlab # [ 157.389241] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.458Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"410196837ffb5a6f2d9e4815","created_at":"2026-07-06T10:41:02.417Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e2dd8de7dfb8477d9dbe06b2c1dba98","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.424Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-410196837ffb5a6f2d9e4815: done: 0.026772 sec","job_status":"done","queue_duration_s":1.007354,"scheduling_latency_s":1.007376,"redis_calls":16,"redis_duration_s":0.003584,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001761,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001355,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000338311,"duration_s":0.026772,"completed_at":"2026-07-06T10:41:03.458Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003986,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 157.394334] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.460Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"66e0da9d5b64b362f3d65d73","created_at":"2026-07-06T10:41:02.430Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad08066860ac952866e45469208a79d6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.437Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-66e0da9d5b64b362f3d65d73: start","job_status":"start","queue_duration_s":1.022623,"scheduling_latency_s":1.022643}1344gitlab # [ 157.478132] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"66e0da9d5b64b362f3d65d73","created_at":"2026-07-06T10:41:02.430Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad08066860ac952866e45469208a79d6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.437Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-66e0da9d5b64b362f3d65d73: done: 0.175946 sec","job_status":"done","queue_duration_s":1.022623,"scheduling_latency_s":1.022643,"redis_calls":12,"redis_duration_s":0.003528,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000486,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001956,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":124,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":124,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":123,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":80,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.123337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000436089,"exclusive_lock_hold_duration_s":0.15705962599999998,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.175946,"completed_at":"2026-07-06T10:41:03.635Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.058295,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 157.547326] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ab0fdd7a4d70359fc94d9900","created_at":"2026-07-06T10:41:02.443Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.450Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ab0fdd7a4d70359fc94d9900: start","job_status":"start","queue_duration_s":1.187144,"scheduling_latency_s":1.187165}1346gitlab # [ 157.548395] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.734Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ab0fdd7a4d70359fc94d9900","created_at":"2026-07-06T10:41:02.443Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.450Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ab0fdd7a4d70359fc94d9900: done: 0.096937 sec","job_status":"done","queue_duration_s":1.187144,"scheduling_latency_s":1.187165,"redis_calls":71,"redis_duration_s":0.016816,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002109,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000731,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013283,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000693,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000403962,"duration_s":0.096937,"completed_at":"2026-07-06T10:41:03.734Z","load_balancing_strategy":"primary","db_duration_s":0.001744,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 157.569147] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.735Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"472d80cbb51275426083b35e","created_at":"2026-07-06T10:41:02.942Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-af5bd8d747c64be3","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4592c1468f8482bb529f5f0a9f3dd5f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.952Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-472d80cbb51275426083b35e: start","job_status":"start","queue_duration_s":0.78343,"scheduling_latency_s":0.783451}1348gitlab # [ 157.639099] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.750Z","message":"No existing merge request to be cleaned up."}1349gitlab # [ 157.640262] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.760Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"472d80cbb51275426083b35e","created_at":"2026-07-06T10:41:02.942Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-af5bd8d747c64be3","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4592c1468f8482bb529f5f0a9f3dd5f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.952Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-472d80cbb51275426083b35e: done: 0.025054 sec","job_status":"done","queue_duration_s":0.78343,"scheduling_latency_s":0.783451,"redis_calls":13,"redis_duration_s":0.003304,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000478,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001268,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001558,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000384685,"duration_s":0.025054,"completed_at":"2026-07-06T10:41:03.760Z","load_balancing_strategy":"primary","db_duration_s":0.002915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 157.713201] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.762Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e51a8f5e38ce6b353ce62869","created_at":"2026-07-06T10:41:02.942Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-af5bd8d747c64be3","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4592c1468f8482bb529f5f0a9f3dd5f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.952Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e51a8f5e38ce6b353ce62869: start","job_status":"start","queue_duration_s":0.809948,"scheduling_latency_s":0.809968}1351gitlab # [ 157.714399] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.772Z","message":"No existing merge request to be cleaned up."}1352gitlab # [ 157.715368] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.778Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e51a8f5e38ce6b353ce62869","created_at":"2026-07-06T10:41:02.942Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-af5bd8d747c64be3","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4592c1468f8482bb529f5f0a9f3dd5f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.952Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e51a8f5e38ce6b353ce62869: done: 0.016348 sec","job_status":"done","queue_duration_s":0.809948,"scheduling_latency_s":0.809968,"redis_calls":10,"redis_duration_s":0.002359,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001423,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016348,"completed_at":"2026-07-06T10:41:03.778Z","load_balancing_strategy":"primary","db_duration_s":0.001501,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 157.730932] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.780Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0392d9f2377180125ff84685","created_at":"2026-07-06T10:41:02.942Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-af5bd8d747c64be3","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4592c1468f8482bb529f5f0a9f3dd5f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.952Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0392d9f2377180125ff84685: start","job_status":"start","queue_duration_s":0.827572,"scheduling_latency_s":0.827593}1354gitlab # [ 157.803498] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.789Z","message":"No existing merge request to be cleaned up."}1355gitlab # [ 157.805068] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.795Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0392d9f2377180125ff84685","created_at":"2026-07-06T10:41:02.942Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-af5bd8d747c64be3","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4592c1468f8482bb529f5f0a9f3dd5f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.952Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0392d9f2377180125ff84685: done: 0.015546 sec","job_status":"done","queue_duration_s":0.827572,"scheduling_latency_s":0.827593,"redis_calls":10,"redis_duration_s":0.002626,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001028,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001598,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015546,"completed_at":"2026-07-06T10:41:03.795Z","load_balancing_strategy":"primary","db_duration_s":0.001266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 157.809953] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.796Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"440b6f35eb8417ad8e95e915","created_at":"2026-07-06T10:41:02.942Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-af5bd8d747c64be3","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4592c1468f8482bb529f5f0a9f3dd5f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.952Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-440b6f35eb8417ad8e95e915: start","job_status":"start","queue_duration_s":0.844382,"scheduling_latency_s":0.844403}1357gitlab # [ 157.892215] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.806Z","message":"No existing merge request to be cleaned up."}1358gitlab # [ 157.893345] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.812Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"440b6f35eb8417ad8e95e915","created_at":"2026-07-06T10:41:02.942Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-af5bd8d747c64be3","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4592c1468f8482bb529f5f0a9f3dd5f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:02.952Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-440b6f35eb8417ad8e95e915: done: 0.015777 sec","job_status":"done","queue_duration_s":0.844382,"scheduling_latency_s":0.844403,"redis_calls":10,"redis_duration_s":0.002471,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001592,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015777,"completed_at":"2026-07-06T10:41:03.812Z","load_balancing_strategy":"primary","db_duration_s":0.00129,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 157.895189] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"927d5c3c084e12358c5d3ef1","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-927d5c3c084e12358c5d3ef1: start","job_status":"start","queue_duration_s":0.088395,"scheduling_latency_s":0.088416}1360gitlab # [ 157.909235] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"927d5c3c084e12358c5d3ef1","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-927d5c3c084e12358c5d3ef1: done: 0.021208 sec","job_status":"done","queue_duration_s":0.088395,"scheduling_latency_s":0.088416,"redis_calls":16,"redis_duration_s":0.003735,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000471,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001137,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002127,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035647,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021208,"completed_at":"2026-07-06T10:41:03.835Z","load_balancing_strategy":"primary","db_duration_s":0.000323,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 157.982308] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da2efd460a0f6b3e540b3ffa","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da2efd460a0f6b3e540b3ffa: start","job_status":"start","queue_duration_s":0.111193,"scheduling_latency_s":0.111212}1362gitlab # [ 158.053433] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da2efd460a0f6b3e540b3ffa","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da2efd460a0f6b3e540b3ffa: done: 0.015479 sec","job_status":"done","queue_duration_s":0.111193,"scheduling_latency_s":0.111212,"redis_calls":13,"redis_duration_s":0.00286,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015479,"completed_at":"2026-07-06T10:41:03.852Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 158.055250] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c4b45a2d658dfe23653cf32","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c4b45a2d658dfe23653cf32: start","job_status":"start","queue_duration_s":0.128155,"scheduling_latency_s":0.128176}1364gitlab # [ 158.068719] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c4b45a2d658dfe23653cf32","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c4b45a2d658dfe23653cf32: done: 0.015309 sec","job_status":"done","queue_duration_s":0.128155,"scheduling_latency_s":0.128176,"redis_calls":13,"redis_duration_s":0.003045,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015309,"completed_at":"2026-07-06T10:41:03.868Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 158.135849] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dad9c9c5817de0d07bdd8ee","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dad9c9c5817de0d07bdd8ee: start","job_status":"start","queue_duration_s":0.144897,"scheduling_latency_s":0.144919}1366gitlab # [ 158.201387] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dad9c9c5817de0d07bdd8ee","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dad9c9c5817de0d07bdd8ee: done: 0.015293 sec","job_status":"done","queue_duration_s":0.144897,"scheduling_latency_s":0.144919,"redis_calls":13,"redis_duration_s":0.0029230000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015293,"completed_at":"2026-07-06T10:41:03.885Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 158.205787] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41a8e4b6a60096be5db6058a","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41a8e4b6a60096be5db6058a: start","job_status":"start","queue_duration_s":0.161458,"scheduling_latency_s":0.161478}1368gitlab # [ 158.271202] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41a8e4b6a60096be5db6058a","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41a8e4b6a60096be5db6058a: done: 0.070037 sec","job_status":"done","queue_duration_s":0.161458,"scheduling_latency_s":0.161478,"redis_calls":13,"redis_duration_s":0.003195,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002255,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.070037,"completed_at":"2026-07-06T10:41:03.957Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 158.283663] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc682d1780bebae429b5c7ff","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc682d1780bebae429b5c7ff: start","job_status":"start","queue_duration_s":0.233027,"scheduling_latency_s":0.233052}1370gitlab # [ 158.355552] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc682d1780bebae429b5c7ff","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc682d1780bebae429b5c7ff: done: 0.015114 sec","job_status":"done","queue_duration_s":0.233027,"scheduling_latency_s":0.233052,"redis_calls":13,"redis_duration_s":0.003009,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015114,"completed_at":"2026-07-06T10:41:03.973Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 158.361397] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b21a0663b32b7e41034f0722","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b21a0663b32b7e41034f0722: start","job_status":"start","queue_duration_s":0.24939,"scheduling_latency_s":0.249409}1372gitlab # [ 158.444211] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b21a0663b32b7e41034f0722","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b21a0663b32b7e41034f0722: done: 0.014872 sec","job_status":"done","queue_duration_s":0.24939,"scheduling_latency_s":0.249409,"redis_calls":13,"redis_duration_s":0.003012,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014872,"completed_at":"2026-07-06T10:41:03.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 158.445933] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:03.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24dd2688e9b6c9f2f11cfd9a","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24dd2688e9b6c9f2f11cfd9a: start","job_status":"start","queue_duration_s":0.265839,"scheduling_latency_s":0.26586}1374gitlab # [ 158.523373] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24dd2688e9b6c9f2f11cfd9a","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24dd2688e9b6c9f2f11cfd9a: done: 0.015123 sec","job_status":"done","queue_duration_s":0.265839,"scheduling_latency_s":0.26586,"redis_calls":13,"redis_duration_s":0.003089,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015123,"completed_at":"2026-07-06T10:41:04.006Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 158.525051] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0335689d578bc4cf4004d569","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0335689d578bc4cf4004d569: start","job_status":"start","queue_duration_s":0.282295,"scheduling_latency_s":0.282315}1376gitlab # [ 158.537198] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0335689d578bc4cf4004d569","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0335689d578bc4cf4004d569: done: 0.015083 sec","job_status":"done","queue_duration_s":0.282295,"scheduling_latency_s":0.282315,"redis_calls":13,"redis_duration_s":0.0029379999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015083,"completed_at":"2026-07-06T10:41:04.022Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 158.612970] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85761b12fb1f895ad9d9edcb","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85761b12fb1f895ad9d9edcb: start","job_status":"start","queue_duration_s":0.298818,"scheduling_latency_s":0.298839}1378gitlab # [ 158.615242] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85761b12fb1f895ad9d9edcb","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85761b12fb1f895ad9d9edcb: done: 0.015217 sec","job_status":"done","queue_duration_s":0.298818,"scheduling_latency_s":0.298839,"redis_calls":13,"redis_duration_s":0.003379,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002495,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015217,"completed_at":"2026-07-06T10:41:04.039Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 158.682442] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91f35e309df3976f378dcb4d","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91f35e309df3976f378dcb4d: start","job_status":"start","queue_duration_s":0.315296,"scheduling_latency_s":0.315317}1380gitlab # [ 158.693092] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91f35e309df3976f378dcb4d","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91f35e309df3976f378dcb4d: done: 0.015211 sec","job_status":"done","queue_duration_s":0.315296,"scheduling_latency_s":0.315317,"redis_calls":13,"redis_duration_s":0.00304,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002125,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015211,"completed_at":"2026-07-06T10:41:04.056Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 158.762210] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7d246f0d1be0d391a674cff","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7d246f0d1be0d391a674cff: start","job_status":"start","queue_duration_s":0.331799,"scheduling_latency_s":0.331819}1382gitlab # [ 158.771230] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7d246f0d1be0d391a674cff","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7d246f0d1be0d391a674cff: done: 0.015184 sec","job_status":"done","queue_duration_s":0.331799,"scheduling_latency_s":0.331819,"redis_calls":13,"redis_duration_s":0.002947,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015184,"completed_at":"2026-07-06T10:41:04.072Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 158.838878] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aca2281c48248fca27b71ca2","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aca2281c48248fca27b71ca2: start","job_status":"start","queue_duration_s":0.348305,"scheduling_latency_s":0.348327}1384gitlab # [ 158.906943] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aca2281c48248fca27b71ca2","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aca2281c48248fca27b71ca2: done: 0.014938 sec","job_status":"done","queue_duration_s":0.348305,"scheduling_latency_s":0.348327,"redis_calls":13,"redis_duration_s":0.00306,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002142,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014938,"completed_at":"2026-07-06T10:41:04.088Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 158.908675] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd9dffd6e07c1ac78e3821ae","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd9dffd6e07c1ac78e3821ae: start","job_status":"start","queue_duration_s":0.364514,"scheduling_latency_s":0.364535}1386gitlab # [ 158.975073] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd9dffd6e07c1ac78e3821ae","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd9dffd6e07c1ac78e3821ae: done: 0.01502 sec","job_status":"done","queue_duration_s":0.364514,"scheduling_latency_s":0.364535,"redis_calls":13,"redis_duration_s":0.003024,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01502,"completed_at":"2026-07-06T10:41:04.105Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 159.044168] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"185e21e7c143615f5b73f899","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-185e21e7c143615f5b73f899: start","job_status":"start","queue_duration_s":0.380875,"scheduling_latency_s":0.380896}1388gitlab # [ 159.045370] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"185e21e7c143615f5b73f899","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-185e21e7c143615f5b73f899: done: 0.01494 sec","job_status":"done","queue_duration_s":0.380875,"scheduling_latency_s":0.380896,"redis_calls":13,"redis_duration_s":0.002959,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01494,"completed_at":"2026-07-06T10:41:04.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 159.113087] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb72f7e88e31eec18f98fab3","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb72f7e88e31eec18f98fab3: start","job_status":"start","queue_duration_s":0.39746,"scheduling_latency_s":0.397481}1390gitlab # [ 159.114216] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb72f7e88e31eec18f98fab3","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb72f7e88e31eec18f98fab3: done: 0.015648 sec","job_status":"done","queue_duration_s":0.39746,"scheduling_latency_s":0.397481,"redis_calls":13,"redis_duration_s":0.0031739999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001034,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00214,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015648,"completed_at":"2026-07-06T10:41:04.138Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 159.180822] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f3e1423f8f937286acd4085","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f3e1423f8f937286acd4085: start","job_status":"start","queue_duration_s":0.414416,"scheduling_latency_s":0.414437}1392gitlab # [ 159.181498] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f3e1423f8f937286acd4085","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f3e1423f8f937286acd4085: done: 0.014899 sec","job_status":"done","queue_duration_s":0.414416,"scheduling_latency_s":0.414437,"redis_calls":13,"redis_duration_s":0.002924,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00197,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014899,"completed_at":"2026-07-06T10:41:04.154Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 159.254897] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7674088135cb8d872f4aed2","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7674088135cb8d872f4aed2: start","job_status":"start","queue_duration_s":0.430659,"scheduling_latency_s":0.43068}1394gitlab # [ 159.255971] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7674088135cb8d872f4aed2","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7674088135cb8d872f4aed2: done: 0.015027 sec","job_status":"done","queue_duration_s":0.430659,"scheduling_latency_s":0.43068,"redis_calls":13,"redis_duration_s":0.0028770000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015027,"completed_at":"2026-07-06T10:41:04.171Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 159.328927] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcb7bcf2298823a72545b730","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcb7bcf2298823a72545b730: start","job_status":"start","queue_duration_s":0.447065,"scheduling_latency_s":0.447085}1396gitlab # [ 159.330049] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcb7bcf2298823a72545b730","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcb7bcf2298823a72545b730: done: 0.015601 sec","job_status":"done","queue_duration_s":0.447065,"scheduling_latency_s":0.447085,"redis_calls":13,"redis_duration_s":0.0030809999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015601,"completed_at":"2026-07-06T10:41:04.188Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 159.400257] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b319153bde307cf54d29635c","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b319153bde307cf54d29635c: start","job_status":"start","queue_duration_s":0.464009,"scheduling_latency_s":0.46403}1398gitlab # [ 159.401776] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b319153bde307cf54d29635c","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b319153bde307cf54d29635c: done: 0.015634 sec","job_status":"done","queue_duration_s":0.464009,"scheduling_latency_s":0.46403,"redis_calls":13,"redis_duration_s":0.003522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002646,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015634,"completed_at":"2026-07-06T10:41:04.205Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 159.474239] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c17db585909716483e974bfc","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c17db585909716483e974bfc: start","job_status":"start","queue_duration_s":0.480961,"scheduling_latency_s":0.480982}1400gitlab # [ 159.475872] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c17db585909716483e974bfc","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c17db585909716483e974bfc: done: 0.01497 sec","job_status":"done","queue_duration_s":0.480961,"scheduling_latency_s":0.480982,"redis_calls":13,"redis_duration_s":0.00296,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01497,"completed_at":"2026-07-06T10:41:04.221Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 159.575122] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"610cc399bd9b20a29cfdd741","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-610cc399bd9b20a29cfdd741: start","job_status":"start","queue_duration_s":0.497187,"scheduling_latency_s":0.497208}1402gitlab # [ 159.576442] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"610cc399bd9b20a29cfdd741","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-610cc399bd9b20a29cfdd741: done: 0.015406 sec","job_status":"done","queue_duration_s":0.497187,"scheduling_latency_s":0.497208,"redis_calls":13,"redis_duration_s":0.0031119999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002244,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015406,"completed_at":"2026-07-06T10:41:04.238Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 159.649924] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f34f5d9204970a9782baa6cf","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f34f5d9204970a9782baa6cf: start","job_status":"start","queue_duration_s":0.513953,"scheduling_latency_s":0.513974}1404gitlab # [ 159.651045] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f34f5d9204970a9782baa6cf","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f34f5d9204970a9782baa6cf: done: 0.015213 sec","job_status":"done","queue_duration_s":0.513953,"scheduling_latency_s":0.513974,"redis_calls":13,"redis_duration_s":0.0029430000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015213,"completed_at":"2026-07-06T10:41:04.254Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 159.730111] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"025ba0fc870c9d1575162b9d","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-025ba0fc870c9d1575162b9d: start","job_status":"start","queue_duration_s":0.53043,"scheduling_latency_s":0.53045}1406gitlab # [ 159.731499] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"025ba0fc870c9d1575162b9d","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-025ba0fc870c9d1575162b9d: done: 0.01568 sec","job_status":"done","queue_duration_s":0.53043,"scheduling_latency_s":0.53045,"redis_calls":13,"redis_duration_s":0.003039,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01568,"completed_at":"2026-07-06T10:41:04.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 159.817074] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98a44a9d1ab2a91aab826a17","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98a44a9d1ab2a91aab826a17: start","job_status":"start","queue_duration_s":0.547543,"scheduling_latency_s":0.547565}1408gitlab # [ 159.818197] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98a44a9d1ab2a91aab826a17","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98a44a9d1ab2a91aab826a17: done: 0.015587 sec","job_status":"done","queue_duration_s":0.547543,"scheduling_latency_s":0.547565,"redis_calls":13,"redis_duration_s":0.002935,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015587,"completed_at":"2026-07-06T10:41:04.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 159.845075] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"852c42a41ef5e30ef68724e1","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-852c42a41ef5e30ef68724e1: start","job_status":"start","queue_duration_s":0.564417,"scheduling_latency_s":0.564439}1410gitlab # [ 159.919337] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"852c42a41ef5e30ef68724e1","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-852c42a41ef5e30ef68724e1: done: 0.01534 sec","job_status":"done","queue_duration_s":0.564417,"scheduling_latency_s":0.564439,"redis_calls":13,"redis_duration_s":0.003007,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01534,"completed_at":"2026-07-06T10:41:04.305Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 159.923056] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7deb9b6f1e7b664221f6eea","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7deb9b6f1e7b664221f6eea: start","job_status":"start","queue_duration_s":0.581631,"scheduling_latency_s":0.581651}1412gitlab # [ 159.942213] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7deb9b6f1e7b664221f6eea","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7deb9b6f1e7b664221f6eea: done: 0.015355 sec","job_status":"done","queue_duration_s":0.581631,"scheduling_latency_s":0.581651,"redis_calls":13,"redis_duration_s":0.002964,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015355,"completed_at":"2026-07-06T10:41:04.322Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 160.009245] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f44d768b5f0c24ed1fa82295","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f44d768b5f0c24ed1fa82295: start","job_status":"start","queue_duration_s":0.598288,"scheduling_latency_s":0.598309}1414gitlab # [ 160.020325] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f44d768b5f0c24ed1fa82295","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f44d768b5f0c24ed1fa82295: done: 0.015702 sec","job_status":"done","queue_duration_s":0.598288,"scheduling_latency_s":0.598309,"redis_calls":13,"redis_duration_s":0.003026,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015702,"completed_at":"2026-07-06T10:41:04.339Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 160.090366] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94e6a57da9b639cf0e197ebc","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94e6a57da9b639cf0e197ebc: start","job_status":"start","queue_duration_s":0.615268,"scheduling_latency_s":0.615288}1416gitlab # [ 160.098128] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94e6a57da9b639cf0e197ebc","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94e6a57da9b639cf0e197ebc: done: 0.01534 sec","job_status":"done","queue_duration_s":0.615268,"scheduling_latency_s":0.615288,"redis_calls":13,"redis_duration_s":0.0029950000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01534,"completed_at":"2026-07-06T10:41:04.356Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 160.180433] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be2c5a503a867fdf1470c847","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be2c5a503a867fdf1470c847: start","job_status":"start","queue_duration_s":0.632669,"scheduling_latency_s":0.63269}1418gitlab # [ 160.181722] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be2c5a503a867fdf1470c847","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be2c5a503a867fdf1470c847: done: 0.017653 sec","job_status":"done","queue_duration_s":0.632669,"scheduling_latency_s":0.63269,"redis_calls":13,"redis_duration_s":0.0029189999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017653,"completed_at":"2026-07-06T10:41:04.375Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 160.281987] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:04.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e7f1dedd67e26e35f617d48","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e7f1dedd67e26e35f617d48: start","job_status":"start","queue_duration_s":0.652131,"scheduling_latency_s":0.65216}1420gitlab # [ 160.575034] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 4056405045 wd_nsec: 40564047681421gitlab # [ 160.342603] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e7f1dedd67e26e35f617d48","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e7f1dedd67e26e35f617d48: done: 2.859651 sec","job_status":"done","queue_duration_s":0.652131,"scheduling_latency_s":0.65216,"redis_calls":13,"redis_duration_s":0.003223,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001236,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":2.859651,"completed_at":"2026-07-06T10:41:07.237Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 160.405768] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0c0205f1607a0c14aa8a9f2","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0c0205f1607a0c14aa8a9f2: start","job_status":"start","queue_duration_s":3.575086,"scheduling_latency_s":3.575124}1423gitlab # [ 160.465851] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0c0205f1607a0c14aa8a9f2","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0c0205f1607a0c14aa8a9f2: done: 0.05995 sec","job_status":"done","queue_duration_s":3.575086,"scheduling_latency_s":3.575124,"redis_calls":13,"redis_duration_s":0.008245,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006178,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.05995,"completed_at":"2026-07-06T10:41:07.360Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 160.530223] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e1512ab9e8800b57db44ddf","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e1512ab9e8800b57db44ddf: start","job_status":"start","queue_duration_s":3.69649,"scheduling_latency_s":3.696527}1425gitlab # [ 160.563125] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e1512ab9e8800b57db44ddf","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e1512ab9e8800b57db44ddf: done: 0.035806 sec","job_status":"done","queue_duration_s":3.69649,"scheduling_latency_s":3.696527,"redis_calls":13,"redis_duration_s":0.006668,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002131,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004537,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035806,"completed_at":"2026-07-06T10:41:07.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 160.625379] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebb75664e947531df4e769c8","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebb75664e947531df4e769c8: start","job_status":"start","queue_duration_s":3.794071,"scheduling_latency_s":3.794157}1427gitlab # [ 160.668206] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebb75664e947531df4e769c8","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebb75664e947531df4e769c8: done: 0.043178 sec","job_status":"done","queue_duration_s":3.794071,"scheduling_latency_s":3.794157,"redis_calls":13,"redis_duration_s":0.007923,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005429,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.043178,"completed_at":"2026-07-06T10:41:07.562Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 160.672894] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2410a7b1205f70909194970","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2410a7b1205f70909194970: start","job_status":"start","queue_duration_s":3.842099,"scheduling_latency_s":3.842142}1429gitlab # [ 160.702166] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2410a7b1205f70909194970","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2410a7b1205f70909194970: done: 0.02927 sec","job_status":"done","queue_duration_s":3.842099,"scheduling_latency_s":3.842142,"redis_calls":13,"redis_duration_s":0.006875,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02927,"completed_at":"2026-07-06T10:41:07.596Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 160.806418] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f838cff1f5a8ef9d99f5fcd1","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f838cff1f5a8ef9d99f5fcd1: start","job_status":"start","queue_duration_s":3.878422,"scheduling_latency_s":3.878446}1431gitlab # [ 160.808339] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f838cff1f5a8ef9d99f5fcd1","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f838cff1f5a8ef9d99f5fcd1: done: 0.024599 sec","job_status":"done","queue_duration_s":3.878422,"scheduling_latency_s":3.878446,"redis_calls":13,"redis_duration_s":0.010713,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003184,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007529,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024599,"completed_at":"2026-07-06T10:41:07.628Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 160.820306] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d595935a25050701860bac24","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d595935a25050701860bac24: start","job_status":"start","queue_duration_s":3.906184,"scheduling_latency_s":3.906206}1433gitlab # [ 160.840135] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d595935a25050701860bac24","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d595935a25050701860bac24: done: 0.016172 sec","job_status":"done","queue_duration_s":3.906184,"scheduling_latency_s":3.906206,"redis_calls":13,"redis_duration_s":0.003559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002565,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016172,"completed_at":"2026-07-06T10:41:07.647Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 160.909074] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"461ca2639a9dd15e4f9fbf8d","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-461ca2639a9dd15e4f9fbf8d: start","job_status":"start","queue_duration_s":3.924013,"scheduling_latency_s":3.924034}1435gitlab # [ 160.918987] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"461ca2639a9dd15e4f9fbf8d","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-461ca2639a9dd15e4f9fbf8d: done: 0.017035 sec","job_status":"done","queue_duration_s":3.924013,"scheduling_latency_s":3.924034,"redis_calls":13,"redis_duration_s":0.004845,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003297,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017035,"completed_at":"2026-07-06T10:41:07.666Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 161.014111] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f337d389460f3c1fd9b4f5ff","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f337d389460f3c1fd9b4f5ff: start","job_status":"start","queue_duration_s":3.942651,"scheduling_latency_s":3.942671}1437gitlab # [ 161.015252] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.684Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f337d389460f3c1fd9b4f5ff","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f337d389460f3c1fd9b4f5ff: done: 0.016716 sec","job_status":"done","queue_duration_s":3.942651,"scheduling_latency_s":3.942671,"redis_calls":13,"redis_duration_s":0.0045839999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001402,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016716,"completed_at":"2026-07-06T10:41:07.684Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 161.099618] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"072dac6d1d1f3f0f145779e6","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-072dac6d1d1f3f0f145779e6: start","job_status":"start","queue_duration_s":3.96116,"scheduling_latency_s":3.961182}1439gitlab # [ 161.100764] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"072dac6d1d1f3f0f145779e6","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-072dac6d1d1f3f0f145779e6: done: 0.019986 sec","job_status":"done","queue_duration_s":3.96116,"scheduling_latency_s":3.961182,"redis_calls":13,"redis_duration_s":0.007606999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00418,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003427,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019986,"completed_at":"2026-07-06T10:41:07.706Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 161.172709] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0a02c17e3f5dc50c6e55c2a","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0a02c17e3f5dc50c6e55c2a: start","job_status":"start","queue_duration_s":3.982501,"scheduling_latency_s":3.982523}1441gitlab # [ 161.174128] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0a02c17e3f5dc50c6e55c2a","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0a02c17e3f5dc50c6e55c2a: done: 0.015703 sec","job_status":"done","queue_duration_s":3.982501,"scheduling_latency_s":3.982523,"redis_calls":13,"redis_duration_s":0.003423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002532,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015703,"completed_at":"2026-07-06T10:41:07.723Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 161.256242] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5b1926dd78ee44e5a70e47d","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5b1926dd78ee44e5a70e47d: start","job_status":"start","queue_duration_s":3.999561,"scheduling_latency_s":3.999581}1443gitlab # [ 161.257350] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5b1926dd78ee44e5a70e47d","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5b1926dd78ee44e5a70e47d: done: 0.015184 sec","job_status":"done","queue_duration_s":3.999561,"scheduling_latency_s":3.999581,"redis_calls":13,"redis_duration_s":0.003063,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015184,"completed_at":"2026-07-06T10:41:07.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 161.329147] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97c65225bd1f7516ad1ce150","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97c65225bd1f7516ad1ce150: start","job_status":"start","queue_duration_s":4.016139,"scheduling_latency_s":4.01616}1445gitlab # [ 161.330475] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97c65225bd1f7516ad1ce150","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97c65225bd1f7516ad1ce150: done: 0.015132 sec","job_status":"done","queue_duration_s":4.016139,"scheduling_latency_s":4.01616,"redis_calls":13,"redis_duration_s":0.002985,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015132,"completed_at":"2026-07-06T10:41:07.756Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 161.431773] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af3cceb9809c062d9b479282","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af3cceb9809c062d9b479282: start","job_status":"start","queue_duration_s":4.033211,"scheduling_latency_s":4.033252}1447gitlab # [ 161.433264] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af3cceb9809c062d9b479282","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af3cceb9809c062d9b479282: done: 0.018113 sec","job_status":"done","queue_duration_s":4.033211,"scheduling_latency_s":4.033252,"redis_calls":13,"redis_duration_s":0.002869,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018113,"completed_at":"2026-07-06T10:41:07.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 161.449849] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e958f0088b14d4a931e10c68","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e958f0088b14d4a931e10c68: start","job_status":"start","queue_duration_s":4.052581,"scheduling_latency_s":4.052601}1449gitlab # [ 161.525555] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e958f0088b14d4a931e10c68","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e958f0088b14d4a931e10c68: done: 0.015085 sec","job_status":"done","queue_duration_s":4.052581,"scheduling_latency_s":4.052601,"redis_calls":13,"redis_duration_s":0.0029509999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015085,"completed_at":"2026-07-06T10:41:07.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 161.528145] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62660e2408d04ea79f1c2b7c","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62660e2408d04ea79f1c2b7c: start","job_status":"start","queue_duration_s":4.069088,"scheduling_latency_s":4.069109}1451gitlab # [ 161.598363] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62660e2408d04ea79f1c2b7c","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62660e2408d04ea79f1c2b7c: done: 0.016205 sec","job_status":"done","queue_duration_s":4.069088,"scheduling_latency_s":4.069109,"redis_calls":13,"redis_duration_s":0.0041919999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001013,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016205,"completed_at":"2026-07-06T10:41:07.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 161.606250] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44997acd08c51e8438ca3529","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44997acd08c51e8438ca3529: start","job_status":"start","queue_duration_s":4.086652,"scheduling_latency_s":4.086674}1453gitlab # [ 161.687399] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44997acd08c51e8438ca3529","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44997acd08c51e8438ca3529: done: 0.015687 sec","job_status":"done","queue_duration_s":4.086652,"scheduling_latency_s":4.086674,"redis_calls":13,"redis_duration_s":0.003488,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002592,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015687,"completed_at":"2026-07-06T10:41:07.827Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 161.689041] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76238ab1512875d3bbfc8680","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76238ab1512875d3bbfc8680: start","job_status":"start","queue_duration_s":4.103647,"scheduling_latency_s":4.103667}1455gitlab # [ 161.704177] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76238ab1512875d3bbfc8680","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76238ab1512875d3bbfc8680: done: 0.015193 sec","job_status":"done","queue_duration_s":4.103647,"scheduling_latency_s":4.103667,"redis_calls":13,"redis_duration_s":0.003123,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015193,"completed_at":"2026-07-06T10:41:07.844Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 161.788117] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c8ed472fc44d5bb56bceddb","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c8ed472fc44d5bb56bceddb: start","job_status":"start","queue_duration_s":4.120153,"scheduling_latency_s":4.120174}1457gitlab # [ 161.789452] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c8ed472fc44d5bb56bceddb","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c8ed472fc44d5bb56bceddb: done: 0.015085 sec","job_status":"done","queue_duration_s":4.120153,"scheduling_latency_s":4.120174,"redis_calls":13,"redis_duration_s":0.0028789999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015085,"completed_at":"2026-07-06T10:41:07.860Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 161.869826] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1feb170773d851526399324","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1feb170773d851526399324: start","job_status":"start","queue_duration_s":4.136495,"scheduling_latency_s":4.136516}1459gitlab # [ 161.871213] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:07.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1feb170773d851526399324","created_at":"2026-07-06T10:41:03.655Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-ed6a8e12d1c64bb8","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c740ae98252393347428a95bf6a801a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:03.725Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1feb170773d851526399324: done: 0.014842 sec","job_status":"done","queue_duration_s":4.136495,"scheduling_latency_s":4.136516,"redis_calls":13,"redis_duration_s":0.002744,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014842,"completed_at":"2026-07-06T10:41:07.876Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 175.108222] setup-gitlab-start[2735]: W, [2026-07-06T10:41:22.002344 #2735] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1461gitlab # [ 199.954656] runuser[2734]: pam_unix(runuser:session): session closed for user gitlab1462gitlab # [ 199.961206] setup-gitlab-start[2966]: ++ jq -r .token1463gitlab # [ 199.963451] setup-gitlab-start[2967]: +++ date -d '+7 days' +%F1464gitlab # [ 199.966847] setup-gitlab-start[2965]: ++ curl -fs -X POST -H 'Authorization: Bearer 5c9276642be34de0e1ba559254c41649e929b8983013bed8e840be47c4271c83' -H 'Content-Type: application/json' -d '{"name":"nixbot","scopes":["api"],"expires_at":"2026-07-13"}' http://gitlab/api/v4/users/1/personal_access_tokens1465gitlab # [ 200.452811] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:47.346Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"1072709cf92cf480ef24a893","created_at":"2026-07-06T10:41:47.320Z","trace_propagation_headers":{"sentry-trace":"c2b123019df04b7eba125acf981f6073-7585d0020cf24122","baggage":"sentry-trace_id=c2b123019df04b7eba125acf981f6073,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA4CDMSKWJZ2JKMH1H4CQ","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:412312dbde457fe1766fb7e4fda7aafee662ad4450caa1fb12493df6efb33158","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:47.343Z","job_size_bytes":451,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-1072709cf92cf480ef24a893: start","job_status":"start","queue_duration_s":0.003238,"scheduling_latency_s":0.003279}1466gitlab # [ 200.539773] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:47 +0000] "POST /api/v4/users/1/personal_access_tokens HTTP/1.1" 201 267 "" "curl/8.20.0" 5401467gitlab # [ 200.544919] setup-gitlab-start[2688]: + TOKEN=glpat-1xvIQW6zGoNMe9PJLhfYVG86MQp1OjEH.01.0w1ahh0ck1468gitlab # [ 200.546974] setup-gitlab-start[2688]: + test -n glpat-1xvIQW6zGoNMe9PJLhfYVG86MQp1OjEH.01.0w1ahh0ck1469gitlab # [ 200.549059] setup-gitlab-start[2688]: + test glpat-1xvIQW6zGoNMe9PJLhfYVG86MQp1OjEH.01.0w1ahh0ck '!=' null1470gitlab # [ 200.551229] setup-gitlab-start[2688]: + mkdir -p /var/lib/secrets1471gitlab # [ 200.552725] setup-gitlab-start[2688]: + echo glpat-1xvIQW6zGoNMe9PJLhfYVG86MQp1OjEH.01.0w1ahh0ck1472gitlab # [ 200.555200] setup-gitlab-start[2688]: + chmod 644 /var/lib/secrets/gitlab-token1473gitlab # [ 200.556920] setup-gitlab-start[2688]: + curl -fs -X POST -H 'PRIVATE-TOKEN: glpat-1xvIQW6zGoNMe9PJLhfYVG86MQp1OjEH.01.0w1ahh0ck' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1474gitlab # [ 200.627785] sidekiq-cluster[2114]: {"severity":"WARN","time":"2026-07-06T10:41:47.521Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"1072709cf92cf480ef24a893","created_at":"2026-07-06T10:41:47.320Z","trace_propagation_headers":{"sentry-trace":"c2b123019df04b7eba125acf981f6073-7585d0020cf24122","baggage":"sentry-trace_id=c2b123019df04b7eba125acf981f6073,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA4CDMSKWJZ2JKMH1H4CQ","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:412312dbde457fe1766fb7e4fda7aafee662ad4450caa1fb12493df6efb33158","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:47.343Z","job_size_bytes":451,"pid":2114,"sidekiq_tid":"lynm","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-1072709cf92cf480ef24a893: fail: 0.17547 sec","job_status":"fail","queue_duration_s":0.003238,"scheduling_latency_s":0.003279,"redis_calls":25,"redis_duration_s":0.009801,"redis_read_bytes":151,"redis_write_bytes":3176,"redis_feature_flag_calls":17,"redis_feature_flag_duration_s":0.006967,"redis_feature_flag_read_bytes":144,"redis_feature_flag_write_bytes":2292,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002208,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000626,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":13,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":13,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":13,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000419047,"duration_s":0.17547,"completed_at":"2026-07-06T10:41:47.521Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.063324,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 201.206623] gitaly[1383]: time="2026-07-06T10:41:47.942Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:41:57.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:47.942" pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1476gitlab # [ 201.208600] gitaly[1383]: time="2026-07-06T10:41:47.943Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:41:57.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:47.942" grpc.time_ms=0.731 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1477gitlab # [ 201.210390] gitaly[1383]: time="2026-07-06T10:41:48.056Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:41:58.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.055" pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1478gitlab # [ 201.211825] gitaly[1383]: time="2026-07-06T10:41:48.056Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:41:58.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.055" grpc.time_ms=0.641 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1479gitlab # [ 201.213440] gitaly[1383]: time="2026-07-06T10:41:48.097Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV diskcache=57440059-e907-4307-a623-bfc85b912a75 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-06T10:41:58.012" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.062" pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1480gitlab # [ 201.293370] gitaly[1383]: time="2026-07-06T10:41:48.097Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=32 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-06T10:41:58.012" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.062" grpc.time_ms=34.765 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1481gitlab # [ 201.295123] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:48.131Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"034ea91a30744d32ec50e34d","created_at":"2026-07-06T10:41:48.122Z","trace_propagation_headers":{"sentry-trace":"0cbb3e7ce7b34e14955d7d707aa2121a-fac6913a7f8b4e26","baggage":"sentry-trace_id=0cbb3e7ce7b34e14955d7d707aa2121a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA4YCWHFZVAYWERGJKTGV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:48.129Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-034ea91a30744d32ec50e34d: start","job_status":"start","queue_duration_s":0.001707,"scheduling_latency_s":0.001749}1482gitlab # [ 201.295951] gitaly[1383]: time="2026-07-06T10:41:48.106Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:41:58.055" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.106" pid=1383 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1483gitlab # [ 201.296984] gitaly[1383]: time="2026-07-06T10:41:48.106Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:41:58.055" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.106" grpc.time_ms=0.478 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1484gitlab # [ 201.368456] gitaly[1383]: time="2026-07-06T10:41:48.116Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-06T10:41:58.059" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.109" grpc.time_ms=6.021 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1485gitlab # [ 201.369916] gitaly[1383]: time="2026-07-06T10:41:48.144Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:41:58.093" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.144" pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1486gitlab # [ 201.372822] gitaly[1383]: time="2026-07-06T10:41:48.144Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:41:58.093" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.144" grpc.time_ms=0.264 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1487gitlab # [ 201.374078] gitaly[1383]: time="2026-07-06T10:41:48.174Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV diskcache=7ab6ed12-d714-434d-a35e-9116440685e3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-06T10:41:58.096" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.147" pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1488gitlab # [ 201.375075] gitaly[1383]: time="2026-07-06T10:41:48.175Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=325 command.oublock=32 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-06T10:41:58.096" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.147" grpc.time_ms=27.734 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1489gitlab # [ 201.443203] gitaly[1383]: time="2026-07-06T10:41:48.180Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:41:58.130" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.180" pid=1383 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1490gitlab # [ 201.444157] gitaly[1383]: time="2026-07-06T10:41:48.181Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:41:58.130" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.180" grpc.time_ms=0.387 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1491gitlab # [ 201.446078] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:48.306Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"034ea91a30744d32ec50e34d","created_at":"2026-07-06T10:41:48.122Z","trace_propagation_headers":{"sentry-trace":"0cbb3e7ce7b34e14955d7d707aa2121a-fac6913a7f8b4e26","baggage":"sentry-trace_id=0cbb3e7ce7b34e14955d7d707aa2121a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA4YCWHFZVAYWERGJKTGV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:48.129Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-034ea91a30744d32ec50e34d: done: 0.17512 sec","job_status":"done","queue_duration_s":0.001707,"scheduling_latency_s":0.001749,"redis_calls":16,"redis_duration_s":0.004167,"redis_read_bytes":268,"redis_write_bytes":1956,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001503,"redis_feature_flag_read_bytes":260,"redis_feature_flag_write_bytes":791,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001583,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.123,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.12,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.036089782,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.17512,"completed_at":"2026-07-06T10:41:48.305Z","load_balancing_strategy":"primary","db_duration_s":0.124626,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1492gitlab # [ 201.533429] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:48.307Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"bc1fcffc84c269881f90c5c3","created_at":"2026-07-06T10:41:48.135Z","trace_propagation_headers":{"sentry-trace":"0cbb3e7ce7b34e14955d7d707aa2121a-fac6913a7f8b4e26","baggage":"sentry-trace_id=0cbb3e7ce7b34e14955d7d707aa2121a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA4YCWHFZVAYWERGJKTGV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:48.140Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-bc1fcffc84c269881f90c5c3: start","job_status":"start","queue_duration_s":0.166939,"scheduling_latency_s":0.166961}1493gitlab # [ 201.534931] gitaly[1383]: time="2026-07-06T10:41:48.190Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-06T10:41:58.133" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.183" grpc.time_ms=6.645 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1494gitlab # [ 201.539841] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:48.390Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"bc1fcffc84c269881f90c5c3","created_at":"2026-07-06T10:41:48.135Z","trace_propagation_headers":{"sentry-trace":"0cbb3e7ce7b34e14955d7d707aa2121a-fac6913a7f8b4e26","baggage":"sentry-trace_id=0cbb3e7ce7b34e14955d7d707aa2121a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA4YCWHFZVAYWERGJKTGV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:48.140Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-bc1fcffc84c269881f90c5c3: done: 0.083158 sec","job_status":"done","queue_duration_s":0.166939,"scheduling_latency_s":0.166961,"redis_calls":14,"redis_duration_s":0.005311,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00061,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003602,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.059051081000000005,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.083158,"completed_at":"2026-07-06T10:41:48.390Z","load_balancing_strategy":"primary","db_duration_s":0.018126,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1495gitlab # [ 201.614154] gitaly[1383]: time="2026-07-06T10:41:48.213Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:41:58.162" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.212" grpc.time_ms=0.217 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1496gitlab # [ 201.683949] gitaly[1383]: time="2026-07-06T10:41:48.219Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-06T10:41:58.168" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.219" grpc.time_ms=0.254 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1497gitlab # [ 201.686191] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:48.479Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"08bfdd1d3cac268a08540134","created_at":"2026-07-06T10:41:48.471Z","trace_propagation_headers":{"sentry-trace":"0cbb3e7ce7b34e14955d7d707aa2121a-fac6913a7f8b4e26","baggage":"sentry-trace_id=0cbb3e7ce7b34e14955d7d707aa2121a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA4YCWHFZVAYWERGJKTGV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:48.477Z","job_size_bytes":5,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-08bfdd1d3cac268a08540134: start","job_status":"start","queue_duration_s":0.001506,"scheduling_latency_s":0.001546}1498gitlab # [ 201.689171] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:48.560Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"08bfdd1d3cac268a08540134","created_at":"2026-07-06T10:41:48.471Z","trace_propagation_headers":{"sentry-trace":"0cbb3e7ce7b34e14955d7d707aa2121a-fac6913a7f8b4e26","baggage":"sentry-trace_id=0cbb3e7ce7b34e14955d7d707aa2121a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA4YCWHFZVAYWERGJKTGV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:48.477Z","job_size_bytes":5,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-08bfdd1d3cac268a08540134: done: 0.081569 sec","job_status":"done","queue_duration_s":0.001506,"scheduling_latency_s":0.001546,"redis_calls":12,"redis_duration_s":0.0030819999999999997,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000819,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001777,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000486,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000405638,"duration_s":0.081569,"completed_at":"2026-07-06T10:41:48.560Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011859,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1499gitlab # [ 201.763827] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:48.562Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"9b307266ccdc3aa23a0cf0a0","created_at":"2026-07-06T10:41:48.501Z","trace_propagation_headers":{"sentry-trace":"0cbb3e7ce7b34e14955d7d707aa2121a-fac6913a7f8b4e26","baggage":"sentry-trace_id=0cbb3e7ce7b34e14955d7d707aa2121a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA4YCWHFZVAYWERGJKTGV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:48.506Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-9b307266ccdc3aa23a0cf0a0: start","job_status":"start","queue_duration_s":0.055466,"scheduling_latency_s":0.055488}1500gitlab # [ 201.766780] gitaly[1383]: time="2026-07-06T10:41:48.530Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA4YCWHFZVAYWERGJKTGV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-06T10:41:58.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:48.524" grpc.time_ms=5.939 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1501gitlab # [ 201.822546] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:48.717Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"9b307266ccdc3aa23a0cf0a0","created_at":"2026-07-06T10:41:48.501Z","trace_propagation_headers":{"sentry-trace":"0cbb3e7ce7b34e14955d7d707aa2121a-fac6913a7f8b4e26","baggage":"sentry-trace_id=0cbb3e7ce7b34e14955d7d707aa2121a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA4YCWHFZVAYWERGJKTGV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:48.506Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-9b307266ccdc3aa23a0cf0a0: done: 0.15517 sec","job_status":"done","queue_duration_s":0.055466,"scheduling_latency_s":0.055488,"redis_calls":11,"redis_duration_s":0.002612,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000657,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001507,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.121,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.121,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000345574,"duration_s":0.15517,"completed_at":"2026-07-06T10:41:48.717Z","load_balancing_strategy":"primary","db_duration_s":0.054407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 201.890398] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:48.719Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"24a5c66fb39aa96e0f026445","created_at":"2026-07-06T10:41:48.509Z","trace_propagation_headers":{"sentry-trace":"0cbb3e7ce7b34e14955d7d707aa2121a-fac6913a7f8b4e26","baggage":"sentry-trace_id=0cbb3e7ce7b34e14955d7d707aa2121a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA4YCWHFZVAYWERGJKTGV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:48.512Z","job_size_bytes":89,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-24a5c66fb39aa96e0f026445: start","job_status":"start","queue_duration_s":0.206098,"scheduling_latency_s":0.206119}1503gitlab # [ 201.891791] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:48.769Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"24a5c66fb39aa96e0f026445","created_at":"2026-07-06T10:41:48.509Z","trace_propagation_headers":{"sentry-trace":"0cbb3e7ce7b34e14955d7d707aa2121a-fac6913a7f8b4e26","baggage":"sentry-trace_id=0cbb3e7ce7b34e14955d7d707aa2121a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA4YCWHFZVAYWERGJKTGV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:48.512Z","job_size_bytes":89,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-24a5c66fb39aa96e0f026445: done: 0.050333 sec","job_status":"done","queue_duration_s":0.206098,"scheduling_latency_s":0.206119,"redis_calls":11,"redis_duration_s":0.002584,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000707,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001434,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000443,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045313,"duration_s":0.050333,"completed_at":"2026-07-06T10:41:48.769Z","load_balancing_strategy":"primary","db_duration_s":0.015296,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 201.972298] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:48 +0000] "POST /api/v4/projects HTTP/1.1" 201 4795 "" "curl/8.20.0" 13971505gitlab # [ 202.008557] setup-gitlab-start[2688]: + mkdir -p /tmp/test-flake1506gitlab # [ 202.010094] setup-gitlab-start[2688]: + cd /tmp/test-flake1507gitlab # [ 202.011512] setup-gitlab-start[2688]: + git init -b master1508gitlab # [ 202.028860] setup-gitlab-start[3009]: Initialized empty Git repository in /tmp/test-flake/.git/1509gitlab # [ 202.031690] setup-gitlab-start[2688]: + git config user.name test1510gitlab # [ 202.033370] setup-gitlab-start[2688]: + git config user.email test@example.com1511gitlab # [ 202.039143] setup-gitlab-start[2688]: + cat1512gitlab # [ 202.040936] setup-gitlab-start[2688]: + git add flake.nix1513gitlab # [ 202.047551] setup-gitlab-start[2688]: + git commit -m 'initial commit'1514gitlab # [ 202.060761] setup-gitlab-start[3014]: [master (root-commit) e3af3df] initial commit1515gitlab # [ 202.061839] setup-gitlab-start[3014]: 1 file changed, 10 insertions(+)1516gitlab # [ 202.062873] setup-gitlab-start[3014]: create mode 100644 flake.nix1517gitlab # [ 202.065490] setup-gitlab-start[2688]: + git remote add origin http://oauth2:glpat-1xvIQW6zGoNMe9PJLhfYVG86MQp1OjEH.01.0w1ahh0ck@gitlab/root/test-flake.git1518gitlab # [ 202.076744] setup-gitlab-start[2688]: + git push -u origin master1519gitlab # [ 202.150693] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:49 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 421520gitlab # [ 202.251115] gitaly[1383]: time="2026-07-06T10:41:49.145Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6FYD6CRDPA6H08DB68A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:49.138" grpc.time_ms=7.126 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1521gitlab # [ 202.256275] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:49 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.54.0" 951522gitlab # [ 202.701487] gitaly[1383]: time="2026-07-06T10:41:49.596Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-06T10:41:59.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:49.580" grpc.time_ms=14.25 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1523gitlab # [ 202.807120] gitaly[1383]: time="2026-07-06T10:41:49.702Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-06T10:42:19.087" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-06T10:41:49.688" grpc.time_ms=13.676 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1524gitlab # [ 202.889557] gitaly[1383]: time="2026-07-06T10:41:49.784Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY duration_ms=415ns method=POST pid=1383 status=200 url="http://unix/api/v4/internal/allowed"1525gitlab # [ 202.937361] gitaly[1383]: time="2026-07-06T10:41:49.832Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY duration_ms=46ns method=POST pid=1383 status=200 url="http://unix/api/v4/internal/pre_receive"1526gitlab # [ 202.949295] gitaly[1383]: time="2026-07-06T10:41:49.844Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5322 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:41:49.368" grpc.time_ms=475.954 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1527gitlab # [ 203.023425] gitaly[1383]: time="2026-07-06T10:41:49.918Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:41:49.917" grpc.time_ms=0.597 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1528gitlab # [ 203.071779] gitaly[1383]: time="2026-07-06T10:41:49.966Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:41:49.966" grpc.time_ms=0.399 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1529gitlab # [ 203.118311] gitaly[1383]: time="2026-07-06T10:41:50.013Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4793 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:41:50.012" grpc.time_ms=0.685 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1530gitlab # [ 203.196656] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:50.091Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 e3af3dfa9f7631d41f2d79f0efcbf50066a02bb2 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"e335f182afb6e3ce5b2711f5","created_at":"2026-07-06T10:41:50.082Z","trace_propagation_headers":{"sentry-trace":"79b78030713a4e95b433552c8ec4ea12-76b1c71fef1e4f0a","baggage":"sentry-trace_id=79b78030713a4e95b433552c8ec4ea12,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA6MS2E11G8CH3ZDHWBAY","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:50.089Z","job_size_bytes":185,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-e335f182afb6e3ce5b2711f5: start","job_status":"start","queue_duration_s":0.00183,"scheduling_latency_s":0.00187}1531gitlab # [ 203.217211] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:50.111Z","message":"changes: \"0000000000000000000000000000000000000000 e3af3dfa9f7631d41f2d79f0efcbf50066a02bb2 refs/heads/master\\n\""}1532gitlab # [ 203.240430] gitaly[1383]: time="2026-07-06T10:41:50.135Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-06T10:42:00.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:50.129" grpc.time_ms=5.956 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1533gitlab # [ 203.250480] gitaly[1383]: time="2026-07-06T10:41:50.145Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-06T10:42:00.088" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:50.138" grpc.time_ms=6.593 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1534gitlab # [ 203.294489] gitaly[1383]: time="2026-07-06T10:41:50.189Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1560 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-06T10:42:00.118" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:50.169" grpc.time_ms=19.498 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1535gitlab # [ 203.308473] gitaly[1383]: time="2026-07-06T10:41:50.203Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY duration_ms=152ns method=POST pid=1383 status=200 url="http://unix/api/v4/internal/post_receive"1536gitlab # [ 203.311113] gitaly[1383]: time="2026-07-06T10:41:50.204Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4816 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:41:50.050" grpc.time_ms=153.996 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1537gitlab # [ 203.350565] gitaly[1383]: time="2026-07-06T10:41:50.245Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY diskcache=650667a2-b106-4076-9b5e-39cbb860e748 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:49.285" pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1538gitlab # [ 203.366386] gitaly[1383]: time="2026-07-06T10:41:50.245Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=248 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13486 command.oublock=32 command.real_time_ms=949 command.spawn_token_fork_ms=3 command.system_time_ms=153 command.user_time_ms=95 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:49.285" grpc.time_ms=960.152 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1539gitlab # [ 203.387681] setup-gitlab-start[3018]: To http://gitlab/root/test-flake.git1540gitlab # [ 203.388918] setup-gitlab-start[3018]: * [new branch] master -> master1541gitlab # [ 203.390078] setup-gitlab-start[3018]: branch 'master' set up to track 'origin/master'.1542gitlab # [ 203.391241] gitlab-workhorse[1283]: time="2026-07-06T10:41:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521543gitlab # [ 203.391957] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:50 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 10371544gitlab # [ 203.393174] gitaly[1383]: time="2026-07-06T10:41:50.263Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:42:00.118" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:50.238" grpc.time_ms=24.947 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1545gitlab # [ 203.394318] systemd[1]: Finished setup-gitlab.service.1546gitlab # [ 203.395122] systemd[1]: Starting nixbot CI service...1547gitlab # [ 203.460400] gitaly[1383]: time="2026-07-06T10:41:50.355Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-06T10:42:00.226" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:50.346" grpc.time_ms=8.616 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1548gitlab # [ 203.503766] gitaly[1383]: time="2026-07-06T10:41:50.398Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3942 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:41:50.398" grpc.time_ms=0.345 pid=1383 span.kind=server system=grpc1549gitlab # [ 203.543121] gitaly[1383]: time="2026-07-06T10:41:50.438Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3944 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:41:50.437" grpc.time_ms=0.431 pid=1383 span.kind=server system=grpc1550gitlab # [ 203.567652] gitaly[1383]: time="2026-07-06T10:41:50.462Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY diskcache=fe78f516-9d78-4b14-b792-689853571d46 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-06T10:42:00.247" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:50.367" pid=1383 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1551gitlab # [ 203.585438] gitaly[1383]: time="2026-07-06T10:41:50.462Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=65 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4926 command.oublock=8 command.real_time_ms=87 command.spawn_token_fork_ms=0 command.system_time_ms=42 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-06T10:42:00.247" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:50.367" grpc.time_ms=94.914 pid=1383 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1552gitlab # [ 203.607601] gitaly[1383]: time="2026-07-06T10:41:50.480Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-06T10:42:00.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:50.479" grpc.time_ms=0.161 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1553gitlab # [ 203.608720] gitaly[1383]: time="2026-07-06T10:41:50.493Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=941 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-06T10:42:00.014" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:50.484" grpc.time_ms=9.303 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1554gitlab # [ 203.710655] gitaly[1383]: time="2026-07-06T10:41:50.605Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=338 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-07-06T10:42:20.098" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:50.598" grpc.time_ms=6.693 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1555gitlab # [ 203.747985] gitaly[1383]: time="2026-07-06T10:41:50.643Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-06T10:42:00.172" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:50.642" grpc.time_ms=0.252 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1556gitlab # [ 203.755459] gitaly[1383]: time="2026-07-06T10:41:50.650Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-06T10:42:00.175" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-07-06T10:41:50.646" grpc.time_ms=4.504 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1557gitlab: (finished: waiting for unit setup-gitlab.service, in 204.72 seconds)1558gitlab # [ 203.775420] gitaly[1383]: time="2026-07-06T10:41:50.670Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:42:00.194" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:50.664" grpc.time_ms=6.137 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1559gitlab: waiting for unit nixbot.service1560gitlab # [ 203.788143] gitaly[1383]: time="2026-07-06T10:41:50.683Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:42:00.205" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:50.676" grpc.time_ms=7.031 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1561gitlab # [ 203.807690] gitaly[1383]: time="2026-07-06T10:41:50.702Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-06T10:42:20.192" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:50.692" grpc.time_ms=9.768 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1562gitlab # [ 204.048846] gitaly[1383]: time="2026-07-06T10:41:50.943Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-06T10:42:00.002" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:50.942" grpc.time_ms=1.159 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1563gitlab # [ 204.077463] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:50.972Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 e3af3dfa9f7631d41f2d79f0efcbf50066a02bb2 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"e335f182afb6e3ce5b2711f5","created_at":"2026-07-06T10:41:50.082Z","trace_propagation_headers":{"sentry-trace":"79b78030713a4e95b433552c8ec4ea12-76b1c71fef1e4f0a","baggage":"sentry-trace_id=79b78030713a4e95b433552c8ec4ea12,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA6MS2E11G8CH3ZDHWBAY","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:50.089Z","job_size_bytes":185,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-e335f182afb6e3ce5b2711f5: done: 0.881338 sec","job_status":"done","queue_duration_s":0.00183,"scheduling_latency_s":0.00187,"gitaly_calls":13,"gitaly_duration_s":0.271718,"redis_calls":196,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.06997,"redis_read_bytes":1445,"redis_write_bytes":19017,"redis_cache_calls":14,"redis_cache_duration_s":0.004739,"redis_cache_read_bytes":16,"redis_cache_write_bytes":884,"redis_feature_flag_calls":28,"redis_feature_flag_duration_s":0.011527,"redis_feature_flag_read_bytes":1044,"redis_feature_flag_write_bytes":3487,"redis_queues_calls":8,"redis_queues_duration_s":0.001244,"redis_queues_read_bytes":8,"redis_queues_write_bytes":4933,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003613,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":91,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.036327,"redis_repository_cache_read_bytes":233,"redis_repository_cache_write_bytes":6319,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.01252,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.068,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.175,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.19,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.068,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.404505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000836977,"exclusive_lock_hold_duration_s":0.101879429,"duration_s":0.881338,"completed_at":"2026-07-06T10:41:50.972Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.129244,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1564gitlab # [ 204.167335] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:50.975Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"bbbdaa1e672dc2247668cfdf","created_at":"2026-07-06T10:41:50.318Z","trace_propagation_headers":{"sentry-trace":"79b78030713a4e95b433552c8ec4ea12-4e590a52a1fa4fed","baggage":"sentry-trace_id=79b78030713a4e95b433552c8ec4ea12,sentry-release=Unknown"},"correlation_id":"01KWVGA6MS2E11G8CH3ZDHWBAY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:50.324Z","job_size_bytes":46,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-bbbdaa1e672dc2247668cfdf: start","job_status":"start","queue_duration_s":0.651597,"scheduling_latency_s":0.65162}1565gitlab # [ 204.169363] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:51.048Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"bbbdaa1e672dc2247668cfdf","created_at":"2026-07-06T10:41:50.318Z","trace_propagation_headers":{"sentry-trace":"79b78030713a4e95b433552c8ec4ea12-4e590a52a1fa4fed","baggage":"sentry-trace_id=79b78030713a4e95b433552c8ec4ea12,sentry-release=Unknown"},"correlation_id":"01KWVGA6MS2E11G8CH3ZDHWBAY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:50.324Z","job_size_bytes":46,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-bbbdaa1e672dc2247668cfdf: done: 0.072346 sec","job_status":"done","queue_duration_s":0.651597,"scheduling_latency_s":0.65162,"gitaly_calls":2,"gitaly_duration_s":0.012899,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007986,"redis_read_bytes":68,"redis_write_bytes":4889,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001238,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000513,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001542,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004005,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":754,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000688,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000326857,"duration_s":0.072346,"completed_at":"2026-07-06T10:41:51.048Z","load_balancing_strategy":"primary","db_duration_s":0.009457,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1566gitlab # [ 204.243612] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:51.049Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"45a8897ec87290ee129ab0f8","created_at":"2026-07-06T10:41:50.336Z","trace_propagation_headers":{"sentry-trace":"79b78030713a4e95b433552c8ec4ea12-4e590a52a1fa4fed","baggage":"sentry-trace_id=79b78030713a4e95b433552c8ec4ea12,sentry-release=Unknown"},"correlation_id":"01KWVGA6MS2E11G8CH3ZDHWBAY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:50.341Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-45a8897ec87290ee129ab0f8: start","job_status":"start","queue_duration_s":0.707836,"scheduling_latency_s":0.707858}1567gitlab # [ 204.246473] gitaly[1383]: time="2026-07-06T10:41:51.014Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-07-06T16:41:51.011" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:51.012" grpc.time_ms=2.649 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1568gitlab # [ 204.320696] gitaly[1383]: time="2026-07-06T10:41:51.027Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-06T10:42:21.020" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:51.020" grpc.time_ms=6.191 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1569gitlab # [ 204.321739] gitaly[1383]: time="2026-07-06T10:41:51.140Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY diskcache=e3ee684a-ea32-422e-acba-99428f206ea9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-06T16:41:51.072" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:51.072" pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1570gitlab # [ 204.322891] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:51.170Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"45a8897ec87290ee129ab0f8","created_at":"2026-07-06T10:41:50.336Z","trace_propagation_headers":{"sentry-trace":"79b78030713a4e95b433552c8ec4ea12-4e590a52a1fa4fed","baggage":"sentry-trace_id=79b78030713a4e95b433552c8ec4ea12,sentry-release=Unknown"},"correlation_id":"01KWVGA6MS2E11G8CH3ZDHWBAY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:50.341Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-45a8897ec87290ee129ab0f8: done: 0.121247 sec","job_status":"done","queue_duration_s":0.707836,"scheduling_latency_s":0.707858,"gitaly_calls":1,"gitaly_duration_s":0.070243,"redis_calls":15,"redis_duration_s":0.00382,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000415,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001594,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00059,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001221,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09768531999999999,"duration_s":0.121247,"completed_at":"2026-07-06T10:41:51.170Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015106,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 204.400184] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:51.172Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"d605d507791917f7712e8da0","created_at":"2026-07-06T10:41:50.475Z","trace_propagation_headers":{"sentry-trace":"79b78030713a4e95b433552c8ec4ea12-4e590a52a1fa4fed","baggage":"sentry-trace_id=79b78030713a4e95b433552c8ec4ea12,sentry-release=Unknown"},"correlation_id":"01KWVGA6MS2E11G8CH3ZDHWBAY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:50.477Z","job_size_bytes":23,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d605d507791917f7712e8da0: start","job_status":"start","queue_duration_s":0.695143,"scheduling_latency_s":0.695166}1572gitlab # [ 204.401669] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:51.210Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"d605d507791917f7712e8da0","created_at":"2026-07-06T10:41:50.475Z","trace_propagation_headers":{"sentry-trace":"79b78030713a4e95b433552c8ec4ea12-4e590a52a1fa4fed","baggage":"sentry-trace_id=79b78030713a4e95b433552c8ec4ea12,sentry-release=Unknown"},"correlation_id":"01KWVGA6MS2E11G8CH3ZDHWBAY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:50.477Z","job_size_bytes":23,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d605d507791917f7712e8da0: done: 0.038324 sec","job_status":"done","queue_duration_s":0.695143,"scheduling_latency_s":0.695166,"gitaly_calls":1,"gitaly_duration_s":0.008627,"redis_calls":16,"redis_duration_s":0.003922,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000296,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001765,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000725,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038324,"completed_at":"2026-07-06T10:41:51.210Z","load_balancing_strategy":"primary","db_duration_s":0.00214,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1573gitlab # [ 204.481904] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:51.212Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"7fabe8ed122bbc475a06cb27","created_at":"2026-07-06T10:41:50.911Z","trace_propagation_headers":{"sentry-trace":"79b78030713a4e95b433552c8ec4ea12-4e590a52a1fa4fed","baggage":"sentry-trace_id=79b78030713a4e95b433552c8ec4ea12,sentry-release=Unknown"},"correlation_id":"01KWVGA6MS2E11G8CH3ZDHWBAY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ddb27ddf483debb0b769cac9b90ed76ee60d877a1e6a154f61a2e4864df8e11","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:50.918Z","job_size_bytes":467,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-7fabe8ed122bbc475a06cb27: start","job_status":"start","queue_duration_s":0.293257,"scheduling_latency_s":0.293286}1574gitlab # [ 204.561485] gitaly[1383]: time="2026-07-06T10:41:51.140Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1283 command.oublock=0 command.real_time_ms=62 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-06T16:41:51.072" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:51.072" grpc.time_ms=67.561 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1575gitlab # [ 204.562695] gitaly[1383]: time="2026-07-06T10:41:51.201Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-06T10:42:21.194" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:51.194" grpc.time_ms=6.242 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1576gitlab # [ 204.563939] gitaly[1383]: time="2026-07-06T10:41:51.246Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:21.245" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:51.246" grpc.time_ms=0.596 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1577gitlab # [ 204.569429] gitaly[1383]: time="2026-07-06T10:41:51.254Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-06T10:42:01.008" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:51.248" grpc.time_ms=6.093 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1578gitlab # [ 204.645384] gitaly[1383]: time="2026-07-06T10:41:51.433Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-06T10:42:21.432" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:51.432" grpc.time_ms=1.216 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1579gitlab # [ 204.647153] nixbot[3118]: {"ts": "2026-07-06T10:41:51.492Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1580gitlab # [ 204.658187] nixbot[3118]: {"ts": "2026-07-06T10:41:51.553Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1581gitlab # [ 204.671323] gitaly[1383]: time="2026-07-06T10:41:51.566Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=264 command.oublock=0 command.real_time_ms=127 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-06T10:42:21.437" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:51.437" grpc.time_ms=128.592 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1582gitlab # [ 204.674109] nixbot[3118]: {"ts": "2026-07-06T10:41:51.569Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1583gitlab # [ 204.678209] nixbot[3118]: {"ts": "2026-07-06T10:41:51.573Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1584gitlab # [ 204.681670] nixbot[3118]: {"ts": "2026-07-06T10:41:51.576Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1585gitlab # [ 204.688349] nixbot[3118]: {"ts": "2026-07-06T10:41:51.583Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1586gitlab # [ 204.692616] nixbot[3118]: {"ts": "2026-07-06T10:41:51.587Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1587gitlab # [ 204.695761] nixbot[3118]: {"ts": "2026-07-06T10:41:51.590Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1588gitlab # [ 204.701540] nixbot[3118]: {"ts": "2026-07-06T10:41:51.596Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1589gitlab # [ 204.705570] nixbot[3118]: {"ts": "2026-07-06T10:41:51.600Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1590gitlab # [ 204.711317] nixbot[3118]: {"ts": "2026-07-06T10:41:51.606Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1591gitlab # [ 204.717314] nixbot[3118]: {"ts": "2026-07-06T10:41:51.612Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1592gitlab # [ 204.723124] nixbot[3118]: {"ts": "2026-07-06T10:41:51.618Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1593gitlab # [ 204.727257] nixbot[3118]: {"ts": "2026-07-06T10:41:51.622Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1594gitlab # [ 204.730953] nixbot[3118]: {"ts": "2026-07-06T10:41:51.626Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1595gitlab # [ 204.736310] nixbot[3118]: {"ts": "2026-07-06T10:41:51.631Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1596gitlab # [ 204.740306] nixbot[3118]: {"ts": "2026-07-06T10:41:51.635Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1597gitlab # [ 204.744296] nixbot[3118]: {"ts": "2026-07-06T10:41:51.639Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1598gitlab # [ 204.749517] nixbot[3118]: {"ts": "2026-07-06T10:41:51.644Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1599gitlab # [ 204.752682] nixbot[3118]: {"ts": "2026-07-06T10:41:51.647Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1600gitlab # [ 204.756083] nixbot[3118]: {"ts": "2026-07-06T10:41:51.651Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1601gitlab # [ 204.780501] gitaly[1383]: time="2026-07-06T10:41:51.675Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:42:01.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:51.665" grpc.time_ms=9.39 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1602gitlab # [ 205.115933] nixbot[3118]: INFO: Started server process [3118]1603gitlab # [ 205.119780] nixbot[3118]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1604gitlab # [ 205.138107] nixbot[3118]: INFO: ::ffff:127.0.0.1:54970 - "GET /health HTTP/1.1" 200 OK1605gitlab # [ 205.145242] systemd[1]: Started nixbot CI service.1606gitlab # [ 205.148932] systemd[1]: Reached target Multi-User System.1607gitlab # [ 205.151772] systemd[1]: Startup finished in 1.654s (kernel) + 4.368s (initrd) + 3min 19.125s (userspace) = 3min 25.148s.1608gitlab # [ 205.354802] gitaly[1383]: time="2026-07-06T10:41:52.249Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=968 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-06T10:42:22.237" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:52.238" grpc.time_ms=10.857 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1609gitlab # [ 205.392898] gitaly[1383]: time="2026-07-06T10:41:52.287Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA6MS2E11G8CH3ZDHWBAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-06T10:42:22.273" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:52.274" grpc.time_ms=13.791 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1610gitlab # [ 205.405189] gitaly[1383]: time="2026-07-06T10:41:52.300Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=969 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGA9CXC4KSTSGF7SECFW8N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-06T10:42:22.083" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:52.283" grpc.time_ms=16.148 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1611gitlab # [ 205.442218] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:52 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 3061612gitlab # [ 205.446099] nixbot[3118]: {"ts": "2026-07-06T10:41:52.338Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1613gitlab # [ 205.459812] nixbot[3118]: {"ts": "2026-07-06T10:41:52.354Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1614gitlab # [ 205.473179] sidekiq-cluster[2114]: {"severity":"WARN","time":"2026-07-06T10:41:52.367Z","class":"CreatePipelineWorker","correlation_id":"01KWVGA6MS2E11G8CH3ZDHWBAY","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"e3af3dfa9f7631d41f2d79f0efcbf50066a02bb2","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"e3af3dfa9f7631d41f2d79f0efcbf50066a02bb2","ref":"refs/heads/master"},"retry":0}1615gitlab # [ 205.484562] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:52.374Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"7fabe8ed122bbc475a06cb27","created_at":"2026-07-06T10:41:50.911Z","trace_propagation_headers":{"sentry-trace":"79b78030713a4e95b433552c8ec4ea12-4e590a52a1fa4fed","baggage":"sentry-trace_id=79b78030713a4e95b433552c8ec4ea12,sentry-release=Unknown"},"correlation_id":"01KWVGA6MS2E11G8CH3ZDHWBAY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ddb27ddf483debb0b769cac9b90ed76ee60d877a1e6a154f61a2e4864df8e11","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:50.918Z","job_size_bytes":467,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-7fabe8ed122bbc475a06cb27: done: 1.162699 sec","job_status":"done","queue_duration_s":0.293257,"scheduling_latency_s":0.293286,"gitaly_calls":7,"gitaly_duration_s":0.254225,"redis_calls":53,"redis_duration_s":0.016585,"redis_read_bytes":171,"redis_write_bytes":4426,"redis_cache_calls":4,"redis_cache_duration_s":0.00203,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.00717,"redis_feature_flag_read_bytes":18,"redis_feature_flag_write_bytes":2433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001528,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004759,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":40,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":40,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.832676,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000398095,"duration_s":1.162699,"completed_at":"2026-07-06T10:41:52.374Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.068494,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1616gitlab # [ 205.553607] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:52.376Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"31d42d2a927a944b022e8df5","created_at":"2026-07-06T10:41:51.035Z","trace_propagation_headers":{"sentry-trace":"79b78030713a4e95b433552c8ec4ea12-c0d27fc820e9407e","baggage":"sentry-trace_id=79b78030713a4e95b433552c8ec4ea12,sentry-release=Unknown"},"correlation_id":"01KWVGA6MS2E11G8CH3ZDHWBAY","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:51.039Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-31d42d2a927a944b022e8df5: start","job_status":"start","queue_duration_s":1.33713,"scheduling_latency_s":1.337152}1617gitlab # [ 205.697445] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 2291618gitlab # [ 205.713668] nixbot[3118]: {"ts": "2026-07-06T10:41:52.593Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1619gitlab # [ 205.722963] nixbot[3118]: {"ts": "2026-07-06T10:41:52.597Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1620gitlab # [ 205.776254] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:52.670Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"31d42d2a927a944b022e8df5","created_at":"2026-07-06T10:41:51.035Z","trace_propagation_headers":{"sentry-trace":"79b78030713a4e95b433552c8ec4ea12-c0d27fc820e9407e","baggage":"sentry-trace_id=79b78030713a4e95b433552c8ec4ea12,sentry-release=Unknown"},"correlation_id":"01KWVGA6MS2E11G8CH3ZDHWBAY","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:51.039Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-31d42d2a927a944b022e8df5: done: 0.294276 sec","job_status":"done","queue_duration_s":1.33713,"scheduling_latency_s":1.337152,"redis_calls":19,"redis_duration_s":0.22021100000000002,"redis_read_bytes":21,"redis_write_bytes":4288,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.110194,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.00087,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2259,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.008649,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.100498,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.015574885,"duration_s":0.294276,"completed_at":"2026-07-06T10:41:52.670Z","load_balancing_strategy":"primary","db_duration_s":0.010306,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 205.842478] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:52.673Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"0dac3a425040fe2b7a731831","created_at":"2026-07-06T10:41:52.645Z","trace_propagation_headers":{"sentry-trace":"79b78030713a4e95b433552c8ec4ea12-9994248e03324f4e","baggage":"sentry-trace_id=79b78030713a4e95b433552c8ec4ea12,sentry-release=Unknown"},"correlation_id":"01KWVGA6MS2E11G8CH3ZDHWBAY","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:52.656Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-0dac3a425040fe2b7a731831: start","job_status":"start","queue_duration_s":0.016975,"scheduling_latency_s":0.016998}1622gitlab # [ 205.857381] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:52.752Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"0dac3a425040fe2b7a731831","created_at":"2026-07-06T10:41:52.645Z","trace_propagation_headers":{"sentry-trace":"79b78030713a4e95b433552c8ec4ea12-9994248e03324f4e","baggage":"sentry-trace_id=79b78030713a4e95b433552c8ec4ea12,sentry-release=Unknown"},"correlation_id":"01KWVGA6MS2E11G8CH3ZDHWBAY","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:52.656Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-0dac3a425040fe2b7a731831: done: 0.078676 sec","job_status":"done","queue_duration_s":0.016975,"scheduling_latency_s":0.016998,"redis_calls":11,"redis_duration_s":0.004375,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00229,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000809,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000497549,"duration_s":0.078676,"completed_at":"2026-07-06T10:41:52.752Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020499,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 205.932248] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 868 "" "python-httpx/0.28.1" 1691624gitlab # [ 205.933157] nixbot[3118]: {"ts": "2026-07-06T10:41:52.771Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1625gitlab: (finished: waiting for unit nixbot.service, in 2.13 seconds)1626gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1627gitlab # [ 206.025376] nixbot[3118]: INFO: ::ffff:127.0.0.1:54982 - "GET /health HTTP/1.1" 200 OK1628gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.02 seconds)1629subtest: project discovered and webhook registered1630gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1631gitlab # [ 206.121254] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "curl/8.20.0" 741632gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds)1633(finished: subtest: project discovered and webhook registered, in 0.10 seconds)1634subtest: push delivers the webhook1635gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1636gitlab # [ 206.200853] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:53 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 261637gitlab # [ 206.281322] gitaly[1383]: time="2026-07-06T10:41:53.175Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=7 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAEHNX25VZB5WN3EHSKA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:53.164" grpc.time_ms=11.021 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1638gitlab # [ 206.325840] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:53 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.54.0" 701639gitlab # Enumerating objects: 5, done.1640gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1641gitlab # Delta compression using up to 4 threads1642gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1643gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 137.00 KiB/s, done.1644gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1645gitlab # [ 206.533403] gitaly[1383]: time="2026-07-06T10:41:53.427Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-06T10:42:03.003" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:53.414" grpc.time_ms=13.439 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1646gitlab # [ 206.617861] gitaly[1383]: time="2026-07-06T10:41:53.512Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-06T10:42:23.302" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-06T10:41:53.502" grpc.time_ms=9.9 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1647gitlab # [ 206.655474] gitaly[1383]: time="2026-07-06T10:41:53.529Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J duration_ms=160ns method=POST pid=1383 status=200 url="http://unix/api/v4/internal/allowed"1648gitlab # [ 206.656799] nixbot[3118]: {"ts": "2026-07-06T10:41:53.524Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1649gitlab # [ 206.659605] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:53 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 7441650gitlab # [ 206.660664] gitaly[1383]: time="2026-07-06T10:41:53.553Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J duration_ms=22ns method=POST pid=1383 status=200 url="http://unix/api/v4/internal/pre_receive"1651gitlab # [ 206.661743] gitaly[1383]: time="2026-07-06T10:41:53.553Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5322 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:41:53.367" grpc.time_ms=185.606 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1652gitlab # [ 206.697112] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "python-httpx/0.28.1" 581653gitlab # [ 206.699203] nixbot[3118]: {"ts": "2026-07-06T10:41:53.592Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1654gitlab # [ 206.719572] gitaly[1383]: time="2026-07-06T10:41:53.613Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:41:53.613" grpc.time_ms=0.674 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1655gitlab # [ 206.750652] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:53 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 868 "" "python-httpx/0.28.1" 491656gitlab # [ 206.752112] nixbot[3118]: {"ts": "2026-07-06T10:41:53.646Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1657gitlab # [ 206.774464] gitaly[1383]: time="2026-07-06T10:41:53.669Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:41:53.665" grpc.time_ms=3.661 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1658gitlab # [ 206.808390] gitaly[1383]: time="2026-07-06T10:41:53.703Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAAZPTAJHCNP9155GF2EN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-07-06T10:42:23.094" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=255 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:53.694" grpc.time_ms=8.365 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1659gitlab # [ 206.839675] gitaly[1383]: time="2026-07-06T10:41:53.734Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4793 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:41:53.734" grpc.time_ms=0.436 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1660gitlab # [ 206.843867] gitaly[1383]: time="2026-07-06T10:41:53.739Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAAZPTAJHCNP9155GF2EN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:23.138" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:53.738" grpc.time_ms=0.544 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1661gitlab # [ 206.854814] gitaly[1383]: time="2026-07-06T10:41:53.749Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAAZPTAJHCNP9155GF2EN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-06T10:42:03.172" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:53.743" grpc.time_ms=6.116 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1662gitlab # [ 206.909248] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 771 "" "python-httpx/0.28.1" 1491663gitlab # [ 206.911519] nixbot[3118]: {"ts": "2026-07-06T10:41:53.806Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1664gitlab # [ 206.974877] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 581665gitlab # [ 206.979216] nixbot[3118]: {"ts": "2026-07-06T10:41:53.871Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1666gitlab # [ 206.985949] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:53.873Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","e3af3dfa9f7631d41f2d79f0efcbf50066a02bb2 d85f2b79a773d93928eac516779bae28bee028ab refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"13f38e53ca0281ef87406a92","created_at":"2026-07-06T10:41:53.848Z","trace_propagation_headers":{"sentry-trace":"73a85f8f64e249a9a4463ed5f3b112ae-a2ae0092ad654b19","baggage":"sentry-trace_id=73a85f8f64e249a9a4463ed5f3b112ae,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGAAJTAMKABKTJAN50HZ7J","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:53.868Z","job_size_bytes":185,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-13f38e53ca0281ef87406a92: start","job_status":"start","queue_duration_s":0.004879,"scheduling_latency_s":0.004919}1667gitlab # [ 207.017804] nixbot[3118]: {"ts": "2026-07-06T10:41:53.880Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1668gitlab # To http://gitlab/root/test-flake.git1669gitlab # e3af3df..d85f2b7 master -> master1670gitlab # [ 207.030209] gitaly[1383]: time="2026-07-06T10:41:53.892Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J duration_ms=73ns method=POST pid=1383 status=200 url="http://unix/api/v4/internal/post_receive"1671gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.91 seconds)1672gitlab: must succeed: git -C /tmp/test-flake rev-parse master1673gitlab # [ 207.035165] gitaly[1383]: time="2026-07-06T10:41:53.894Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4816 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:41:53.818" grpc.time_ms=74.326 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1674gitlab # [ 207.053807] gitaly[1383]: time="2026-07-06T10:41:53.919Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J diskcache=a7427cc1-ac41-44df-8a62-5292e9db7c87 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:53.299" pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1675gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.03 seconds)1676gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d85f2b79a773d93928eac516779bae28bee028ab'1677gitlab # [ 207.070141] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:53.900Z","message":"changes: \"e3af3dfa9f7631d41f2d79f0efcbf50066a02bb2 d85f2b79a773d93928eac516779bae28bee028ab refs/heads/master\\n\""}1678gitlab # [ 207.074649] gitlab-workhorse[1283]: time="2026-07-06T10:41:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521679gitlab # [ 207.077866] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:53 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 6781680gitlab # [ 207.082094] gitaly[1383]: time="2026-07-06T10:41:53.920Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=172 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=12966 command.oublock=32 command.real_time_ms=608 command.spawn_token_fork_ms=1 command.system_time_ms=123 command.user_time_ms=49 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:53.299" grpc.time_ms=620.874 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1681gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d85f2b79a773d93928eac516779bae28bee028ab', in 0.04 seconds)1682gitlab # [ 207.103771] gitaly[1383]: time="2026-07-06T10:41:53.923Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:42:03.256" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:53.916" grpc.time_ms=6.497 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1683gitlab # [ 207.123909] gitaly[1383]: time="2026-07-06T10:41:53.940Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-06T10:42:03.273" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:53.933" grpc.time_ms=6.769 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1684gitlab # [ 207.144412] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 901685gitlab # [ 207.145743] nixbot[3118]: INFO: ::ffff:127.0.0.1:54988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d85f2b79a773d93928eac516779bae28bee028ab HTTP/1.1" 200 OK1686gitlab # [ 207.146973] gitaly[1383]: time="2026-07-06T10:41:53.964Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-06T10:42:03.014" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:53.954" grpc.time_ms=10.222 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1687gitlab # [ 207.148290] gitaly[1383]: time="2026-07-06T10:41:53.976Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-07-06T10:42:23.068" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:53.969" grpc.time_ms=7.772 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1688gitlab # [ 207.149083] gitaly[1383]: time="2026-07-06T10:41:53.988Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-06T10:42:03.003" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-07-06T10:41:53.984" grpc.time_ms=3.764 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1689gitlab # [ 207.153074] gitaly[1383]: time="2026-07-06T10:41:54.007Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAB7Z12HE6TQPHQ2PT1T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:53.991" grpc.time_ms=15.381 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc1690gitlab # [ 207.169461] gitaly[1383]: time="2026-07-06T10:41:54.016Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:42:04.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:54.004" grpc.time_ms=12.068 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1691gitlab # [ 207.286159] gitaly[1383]: time="2026-07-06T10:41:54.181Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGABAVA5MHW0KBRYTSQ2MW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:54.173" pid=1383 remote_ip="2001:db8:1::1" request_sha=083c43590fffa527704b32b8836424e8ed055017 response_bytes=149 span.kind=server system=grpc1692gitlab # [ 207.287370] gitaly[1383]: time="2026-07-06T10:41:54.181Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGABAVA5MHW0KBRYTSQ2MW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:54.173" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc1693gitlab # [ 207.291128] gitaly[1383]: time="2026-07-06T10:41:54.185Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGABAVA5MHW0KBRYTSQ2MW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:54.173" grpc.time_ms=8.739 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc1694gitlab # [ 207.294167] gitlab-workhorse[1283]: time="2026-07-06T10:41:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1491695gitlab # [ 207.294878] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.54.0" 1721696gitlab # [ 207.373093] gitaly[1383]: time="2026-07-06T10:41:54.268Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGABGBDZTAS7CHJS49416F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:54.250" pid=1383 remote_ip="2001:db8:1::1" request_sha=5f7f17bce22a557dde0f18ab9f945804ec72a991 response_bytes=419 span.kind=server system=grpc1697gitlab # [ 207.389427] gitaly[1383]: time="2026-07-06T10:41:54.268Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1206 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGABGBDZTAS7CHJS49416F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:54.250" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc1698gitlab # [ 207.410775] gitlab-workhorse[1283]: time="2026-07-06T10:41:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4191699gitlab # [ 207.411758] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 419 "" "git/2.54.0" 821700gitlab # [ 207.413790] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:54.296Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","e3af3dfa9f7631d41f2d79f0efcbf50066a02bb2 d85f2b79a773d93928eac516779bae28bee028ab refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"13f38e53ca0281ef87406a92","created_at":"2026-07-06T10:41:53.848Z","trace_propagation_headers":{"sentry-trace":"73a85f8f64e249a9a4463ed5f3b112ae-a2ae0092ad654b19","baggage":"sentry-trace_id=73a85f8f64e249a9a4463ed5f3b112ae,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGAAJTAMKABKTJAN50HZ7J","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:41:53.868Z","job_size_bytes":185,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-13f38e53ca0281ef87406a92: done: 0.422562 sec","job_status":"done","queue_duration_s":0.004879,"scheduling_latency_s":0.004919,"gitaly_calls":7,"gitaly_duration_s":0.070632,"redis_calls":112,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.041597,"redis_read_bytes":350,"redis_write_bytes":13063,"redis_cache_calls":9,"redis_cache_duration_s":0.005382,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00329,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":323,"redis_queues_calls":8,"redis_queues_duration_s":0.001838,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6763,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.004602,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.011779,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.014706,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":29,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":29,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.026,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.026,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.239348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000559568,"exclusive_lock_hold_duration_s":0.021799978,"duration_s":0.422562,"completed_at":"2026-07-06T10:41:54.296Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050583,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1701gitlab # [ 207.426805] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:54.297Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"1123d745dab4930b03787ae7","created_at":"2026-07-06T10:41:53.942Z","trace_propagation_headers":{"sentry-trace":"73a85f8f64e249a9a4463ed5f3b112ae-31c2d9c8c7ad4df9","baggage":"sentry-trace_id=73a85f8f64e249a9a4463ed5f3b112ae,sentry-release=Unknown"},"correlation_id":"01KWVGAAJTAMKABKTJAN50HZ7J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:53.944Z","job_size_bytes":46,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-1123d745dab4930b03787ae7: start","job_status":"start","queue_duration_s":0.352891,"scheduling_latency_s":0.352918}1702gitlab # [ 207.450363] gitaly[1383]: time="2026-07-06T10:41:54.269Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1206 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGABGBDZTAS7CHJS49416F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:54.250" grpc.time_ms=18.134 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc1703gitlab # [ 207.533468] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:54.337Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"1123d745dab4930b03787ae7","created_at":"2026-07-06T10:41:53.942Z","trace_propagation_headers":{"sentry-trace":"73a85f8f64e249a9a4463ed5f3b112ae-31c2d9c8c7ad4df9","baggage":"sentry-trace_id=73a85f8f64e249a9a4463ed5f3b112ae,sentry-release=Unknown"},"correlation_id":"01KWVGAAJTAMKABKTJAN50HZ7J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:53.944Z","job_size_bytes":46,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-1123d745dab4930b03787ae7: done: 0.037697 sec","job_status":"done","queue_duration_s":0.352891,"scheduling_latency_s":0.352918,"redis_calls":9,"redis_duration_s":0.006758,"redis_read_bytes":23,"redis_write_bytes":782,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000717,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002976,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037697,"completed_at":"2026-07-06T10:41:54.337Z","load_balancing_strategy":"primary","db_duration_s":0.00979,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1704gitlab # [ 207.601368] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:54.341Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b4a7ab68ab97b1840cbcf539","created_at":"2026-07-06T10:41:53.949Z","trace_propagation_headers":{"sentry-trace":"73a85f8f64e249a9a4463ed5f3b112ae-31c2d9c8c7ad4df9","baggage":"sentry-trace_id=73a85f8f64e249a9a4463ed5f3b112ae,sentry-release=Unknown"},"correlation_id":"01KWVGAAJTAMKABKTJAN50HZ7J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:53.950Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b4a7ab68ab97b1840cbcf539: start","job_status":"start","queue_duration_s":0.390047,"scheduling_latency_s":0.390076}1705gitlab # [ 207.604540] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 661706gitlab # [ 207.605736] gitlab-workhorse[1283]: time="2026-07-06T10:41:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671707gitlab # [ 207.607836] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 631708gitlab # [ 207.609346] gitaly[1383]: time="2026-07-06T10:41:54.272Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-06T10:42:04.271" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:54.271" grpc.time_ms=0.773 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1709gitlab # [ 207.610864] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:54.431Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b4a7ab68ab97b1840cbcf539","created_at":"2026-07-06T10:41:53.949Z","trace_propagation_headers":{"sentry-trace":"73a85f8f64e249a9a4463ed5f3b112ae-31c2d9c8c7ad4df9","baggage":"sentry-trace_id=73a85f8f64e249a9a4463ed5f3b112ae,sentry-release=Unknown"},"correlation_id":"01KWVGAAJTAMKABKTJAN50HZ7J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:53.950Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b4a7ab68ab97b1840cbcf539: done: 0.090134 sec","job_status":"done","queue_duration_s":0.390047,"scheduling_latency_s":0.390076,"gitaly_calls":1,"gitaly_duration_s":0.032766,"redis_calls":12,"redis_duration_s":0.012910999999999999,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005082,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003038,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004791,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.04891739,"duration_s":0.090134,"completed_at":"2026-07-06T10:41:54.431Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1710gitlab # [ 207.694178] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:54.434Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"182f604692460323c16cdff6","created_at":"2026-07-06T10:41:54.074Z","trace_propagation_headers":{"sentry-trace":"73a85f8f64e249a9a4463ed5f3b112ae-31c2d9c8c7ad4df9","baggage":"sentry-trace_id=73a85f8f64e249a9a4463ed5f3b112ae,sentry-release=Unknown"},"correlation_id":"01KWVGAAJTAMKABKTJAN50HZ7J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:460a8d567a83ba21eb69bf115dfd77b85e4435de9f3abdcc0b0d71103d767f3e","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:54.075Z","job_size_bytes":467,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-182f604692460323c16cdff6: start","job_status":"start","queue_duration_s":0.358217,"scheduling_latency_s":0.358241}1711gitlab # [ 207.696292] gitaly[1383]: time="2026-07-06T10:41:54.370Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWVGABM1F1RHN7RP3F8AYEZ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:54.362" grpc.time_ms=7.577 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc1712gitlab # [ 207.707604] gitaly[1383]: time="2026-07-06T10:41:54.413Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J diskcache=72824ff3-e92b-4958-9b41-875d5066a40c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-06T16:41:54.382" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:54.383" pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1713gitlab # [ 207.720941] gitaly[1383]: time="2026-07-06T10:41:54.413Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1653 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-06T16:41:54.382" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:54.383" grpc.time_ms=30.521 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1714gitlab # [ 207.747451] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 1321715gitlab # [ 207.752115] gitaly[1383]: time="2026-07-06T10:41:54.435Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGABP5AZ5WXKCQ78FRQBDA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:54.422" pid=1383 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1716gitlab # [ 207.767103] gitaly[1383]: time="2026-07-06T10:41:54.436Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGABP5AZ5WXKCQ78FRQBDA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:54.422" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc1717gitlab # [ 207.785492] gitaly[1383]: time="2026-07-06T10:41:54.436Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGABP5AZ5WXKCQ78FRQBDA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:54.422" grpc.time_ms=13.463 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc1718gitlab # [ 207.805284] gitaly[1383]: time="2026-07-06T10:41:54.595Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:24.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:54.594" grpc.time_ms=0.906 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1719gitlab # [ 207.824307] gitaly[1383]: time="2026-07-06T10:41:54.601Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGABS6AJT87CHH6GBADBTD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:54.587" grpc.time_ms=13.848 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc1720gitlab # [ 207.890144] gitaly[1383]: time="2026-07-06T10:41:54.610Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-06T10:42:04.006" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:54.597" grpc.time_ms=12.824 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1721gitlab # [ 207.893205] gitlab-workhorse[1283]: time="2026-07-06T10:41:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161722gitlab # [ 207.893874] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.54.0" 1241723gitlab # [ 207.894983] gitaly[1383]: time="2026-07-06T10:41:54.639Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-06T10:42:24.136" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:54.637" grpc.time_ms=2.389 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1724gitlab # [ 207.901186] gitaly[1383]: time="2026-07-06T10:41:54.647Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=203 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=3 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-06T10:42:24.142" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:54.642" grpc.time_ms=4.907 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1725gitlab # [ 207.911893] gitaly[1383]: time="2026-07-06T10:41:54.687Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:42:04.090" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:54.680" grpc.time_ms=7.212 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1726gitlab # [ 207.931888] gitaly[1383]: time="2026-07-06T10:41:54.728Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGABXEKHH1G3ZF258WZT8W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:54.701" pid=1383 remote_ip="2001:db8:1::1" request_sha=f1e6bb59289c4d43fc3699ed3fc4760ee01ef0e9 response_bytes=216 span.kind=server system=grpc1727gitlab # [ 207.947266] gitaly[1383]: time="2026-07-06T10:41:54.728Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGABXEKHH1G3ZF258WZT8W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:54.701" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc1728gitlab # [ 208.025306] gitaly[1383]: time="2026-07-06T10:41:54.729Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGABXEKHH1G3ZF258WZT8W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:41:54.701" grpc.time_ms=27.801 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc1729gitlab # [ 208.026757] gitaly[1383]: time="2026-07-06T10:41:54.913Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAC5F8KXPXWZ4RQJWR49M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:24.311" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:54.912" grpc.time_ms=0.637 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1730gitlab # [ 208.051608] gitaly[1383]: time="2026-07-06T10:41:54.946Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAC5F8KXPXWZ4RQJWR49M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-07-06T10:42:24.337" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:54.937" grpc.time_ms=8.615 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1731gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d85f2b79a773d93928eac516779bae28bee028ab'1732gitlab # [ 208.064444] gitaly[1383]: time="2026-07-06T10:41:54.959Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAC5F8KXPXWZ4RQJWR49M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:42:04.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:54.953" grpc.time_ms=5.55 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1733gitlab # [ 208.108809] gitaly[1383]: time="2026-07-06T10:41:55.003Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAC5F8KXPXWZ4RQJWR49M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-06T10:42:05.003" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:55.003" grpc.time_ms=0.214 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1734gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d85f2b79a773d93928eac516779bae28bee028ab', in 0.04 seconds)1735(finished: subtest: push delivers the webhook, in 2.02 seconds)1736subtest: eval and build post commit statuses1737gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses1738gitlab # [ 208.127137] gitaly[1383]: time="2026-07-06T10:41:55.022Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAC5F8KXPXWZ4RQJWR49M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-06T10:42:05.011" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:41:55.012" grpc.time_ms=6.917 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1739gitlab # [ 208.146548] nixbot[3118]: INFO: ::ffff:127.0.0.1:54992 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d85f2b79a773d93928eac516779bae28bee028ab HTTP/1.1" 200 OK1740gitlab # [ 208.176637] gitaly[1383]: time="2026-07-06T10:41:55.071Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGAC5F8KXPXWZ4RQJWR49M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4159 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:41:55.071" grpc.time_ms=0.36 pid=1383 span.kind=server system=grpc1741gitlab # [ 208.212757] gitaly[1383]: time="2026-07-06T10:41:55.107Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGAC5F8KXPXWZ4RQJWR49M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4161 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:41:55.106" grpc.time_ms=0.836 pid=1383 span.kind=server system=grpc1742gitlab # [ 208.227233] gitaly[1383]: time="2026-07-06T10:41:55.119Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGACBQSHMR4QPXAXD7XR93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:25.012" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:55.113" grpc.time_ms=6.633 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1743gitlab # [ 208.246169] gitaly[1383]: time="2026-07-06T10:41:55.133Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=8 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-06T10:42:25.018" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:55.119" grpc.time_ms=14.183 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1744gitlab # [ 208.249896] gitaly[1383]: time="2026-07-06T10:41:55.145Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAAJTAMKABKTJAN50HZ7J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-06T10:42:25.036" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:55.136" grpc.time_ms=8.259 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745gitlab # [ 208.257191] gitaly[1383]: time="2026-07-06T10:41:55.152Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAC5F8KXPXWZ4RQJWR49M diskcache=e5eb68b3-7751-421d-84af-f2e3371504e0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-06T10:42:05.024" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:55.026" pid=1383 ref=refs/keep-around/d85f2b79a773d93928eac516779bae28bee028ab remote_ip="2001:db8:1::1" revision=d85f2b79a773d93928eac516779bae28bee028ab span.kind=server system=grpc username=root1746gitlab # [ 208.258239] gitaly[1383]: time="2026-07-06T10:41:55.153Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=83 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5095 command.oublock=8 command.real_time_ms=115 command.spawn_token_fork_ms=2 command.system_time_ms=68 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAC5F8KXPXWZ4RQJWR49M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-06T10:42:05.024" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-06T10:41:55.026" grpc.time_ms=126.83 pid=1383 ref=refs/keep-around/d85f2b79a773d93928eac516779bae28bee028ab remote_ip="2001:db8:1::1" revision=d85f2b79a773d93928eac516779bae28bee028ab span.kind=server system=grpc username=root1747gitlab # [ 208.264388] sidekiq-cluster[2114]: {"severity":"WARN","time":"2026-07-06T10:41:55.154Z","class":"CreatePipelineWorker","correlation_id":"01KWVGAAJTAMKABKTJAN50HZ7J","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"e3af3dfa9f7631d41f2d79f0efcbf50066a02bb2","after":"d85f2b79a773d93928eac516779bae28bee028ab","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"d85f2b79a773d93928eac516779bae28bee028ab","ref":"refs/heads/master"},"retry":0}1748gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses, in 0.24 seconds)1749gitlab # [ 208.330974] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:55.161Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"182f604692460323c16cdff6","created_at":"2026-07-06T10:41:54.074Z","trace_propagation_headers":{"sentry-trace":"73a85f8f64e249a9a4463ed5f3b112ae-31c2d9c8c7ad4df9","baggage":"sentry-trace_id=73a85f8f64e249a9a4463ed5f3b112ae,sentry-release=Unknown"},"correlation_id":"01KWVGAAJTAMKABKTJAN50HZ7J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:460a8d567a83ba21eb69bf115dfd77b85e4435de9f3abdcc0b0d71103d767f3e","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:54.075Z","job_size_bytes":467,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-182f604692460323c16cdff6: done: 0.727185 sec","job_status":"done","queue_duration_s":0.358217,"scheduling_latency_s":0.358241,"gitaly_calls":7,"gitaly_duration_s":0.069725,"redis_calls":33,"redis_duration_s":0.010616,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.001555,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001511,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.005173,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002377,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":30,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":26,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.566392,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.727185,"completed_at":"2026-07-06T10:41:55.161Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040241,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1750gitlab # [ 208.343053] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:55.162Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"a179d3dc-bce3-41af-aac1-60e22e2f2f1b\"}"],"class":"WebHookWorker","jid":"f2d49b92a65b0a3ed40a5884","created_at":"2026-07-06T10:41:54.245Z","trace_propagation_headers":{"sentry-trace":"73a85f8f64e249a9a4463ed5f3b112ae-31c2d9c8c7ad4df9","baggage":"sentry-trace_id=73a85f8f64e249a9a4463ed5f3b112ae,sentry-release=Unknown"},"correlation_id":"01KWVGAAJTAMKABKTJAN50HZ7J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:480ea71966c3c172149cda71d0c4f2ac7d945496e8cd5ea11cdab9f6b9ec5209","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:54.258Z","job_size_bytes":1749,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-f2d49b92a65b0a3ed40a5884: start","job_status":"start","queue_duration_s":0.904363,"scheduling_latency_s":0.904388}1751gitlab # [ 208.428904] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses HTTP/1.1" 200 2 "" "curl/8.20.0" 991752gitlab # [ 208.430147] gitaly[1383]: time="2026-07-06T10:41:55.159Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAC5F8KXPXWZ4RQJWR49M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:25.058" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:55.158" grpc.time_ms=0.353 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1753gitlab # [ 208.517361] nixbot[3118]: INFO: ::ffff:127.0.0.1:55006 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1754gitlab # [ 208.535365] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:55.430Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"a179d3dc-bce3-41af-aac1-60e22e2f2f1b\"}"],"class":"WebHookWorker","jid":"f2d49b92a65b0a3ed40a5884","created_at":"2026-07-06T10:41:54.245Z","trace_propagation_headers":{"sentry-trace":"73a85f8f64e249a9a4463ed5f3b112ae-31c2d9c8c7ad4df9","baggage":"sentry-trace_id=73a85f8f64e249a9a4463ed5f3b112ae,sentry-release=Unknown"},"correlation_id":"01KWVGAAJTAMKABKTJAN50HZ7J","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:480ea71966c3c172149cda71d0c4f2ac7d945496e8cd5ea11cdab9f6b9ec5209","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:54.258Z","job_size_bytes":1749,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-f2d49b92a65b0a3ed40a5884: done: 0.267192 sec","job_status":"done","queue_duration_s":0.904363,"scheduling_latency_s":0.904388,"redis_calls":19,"redis_duration_s":0.115746,"redis_read_bytes":31,"redis_write_bytes":5281,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001348,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000644,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3643,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.112552,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001202,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.068,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.068,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.013893664999983457,"cpu_s":0.060036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000516267,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","duration_s":0.267192,"completed_at":"2026-07-06T10:41:55.430Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.068347,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1755gitlab # [ 208.571395] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:55.432Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"02c520099ffaa004521281a6","created_at":"2026-07-06T10:41:55.165Z","trace_propagation_headers":{"sentry-trace":"d6a515556caf4d59a80d1f1bc9490725-28e3d1bdde2c4720","baggage":"sentry-trace_id=d6a515556caf4d59a80d1f1bc9490725,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGAC5F8KXPXWZ4RQJWR49M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:55.284Z","job_size_bytes":65,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-02c520099ffaa004521281a6: start","job_status":"start","queue_duration_s":0.147914,"scheduling_latency_s":0.147936}1756gitlab # [ 208.598689] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d85f2b79a773d93928eac516779bae28bee028ab HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 6291757gitlab # [ 208.600121] nixbot[3118]: {"ts": "2026-07-06T10:41:55.494Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d85f2b79a773d93928eac516779bae28bee028ab \"HTTP/1.1 201 Created\""}1758gitlab # [ 208.607559] nixbot[3118]: {"ts": "2026-07-06T10:41:55.502Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-d85f2b79a773-936ce29d", "argv0": "bwrap"}1759gitlab # [ 208.655981] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:55.550Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"02c520099ffaa004521281a6","created_at":"2026-07-06T10:41:55.165Z","trace_propagation_headers":{"sentry-trace":"d6a515556caf4d59a80d1f1bc9490725-28e3d1bdde2c4720","baggage":"sentry-trace_id=d6a515556caf4d59a80d1f1bc9490725,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGAC5F8KXPXWZ4RQJWR49M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:55.284Z","job_size_bytes":65,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-02c520099ffaa004521281a6: done: 0.118404 sec","job_status":"done","queue_duration_s":0.147914,"scheduling_latency_s":0.147936,"redis_calls":18,"redis_duration_s":0.0071449999999999994,"redis_read_bytes":271,"redis_write_bytes":2103,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.00409,"redis_feature_flag_read_bytes":264,"redis_feature_flag_write_bytes":1285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002273,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000782,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.073,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.071,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000520737,"duration_s":0.118404,"completed_at":"2026-07-06T10:41:55.550Z","load_balancing_strategy":"primary","db_duration_s":0.079123,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1760gitlab # [ 208.726482] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:55.621Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"94f012f91deac6eeb4c5303c","created_at":"2026-07-06T10:41:55.353Z","trace_propagation_headers":{"sentry-trace":"d6a515556caf4d59a80d1f1bc9490725-28e3d1bdde2c4720","baggage":"sentry-trace_id=d6a515556caf4d59a80d1f1bc9490725,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGAC5F8KXPXWZ4RQJWR49M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:55.359Z","job_size_bytes":65,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-94f012f91deac6eeb4c5303c: start","job_status":"start","queue_duration_s":0.261272,"scheduling_latency_s":0.26131}1761gitlab # [ 208.802247] systemd[1]: Started Nix Daemon.1762gitlab # [ 208.831741] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:55.726Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"94f012f91deac6eeb4c5303c","created_at":"2026-07-06T10:41:55.353Z","trace_propagation_headers":{"sentry-trace":"d6a515556caf4d59a80d1f1bc9490725-28e3d1bdde2c4720","baggage":"sentry-trace_id=d6a515556caf4d59a80d1f1bc9490725,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGAC5F8KXPXWZ4RQJWR49M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:55.359Z","job_size_bytes":65,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-94f012f91deac6eeb4c5303c: done: 0.105442 sec","job_status":"done","queue_duration_s":0.261272,"scheduling_latency_s":0.26131,"redis_calls":15,"redis_duration_s":0.005835,"redis_read_bytes":142,"redis_write_bytes":1431,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001157,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":431,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00237,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002308,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000590019,"duration_s":0.105442,"completed_at":"2026-07-06T10:41:55.726Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028471,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1763gitlab # [ 208.908834] nix-daemon[3433]: accepted connection from pid 3432, user nixbot1764gitlab # [ 208.912978] nix-daemon[3433]: accepted connection from pid 3431, user nixbot1765gitlab # [ 208.914572] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:55.807Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","f2d49b92a65b0a3ed40a5884"],"class":"WebHooks::LogExecutionWorker","jid":"5602aa1af82e8926b7ffb530","created_at":"2026-07-06T10:41:55.416Z","trace_propagation_headers":{"sentry-trace":"73a85f8f64e249a9a4463ed5f3b112ae-148c50f16c554e62","baggage":"sentry-trace_id=73a85f8f64e249a9a4463ed5f3b112ae,sentry-release=Unknown"},"correlation_id":"01KWVGAAJTAMKABKTJAN50HZ7J","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9cbf3b55981bee867fe99591b7b0d3df2514959b509d835a05b3c0968f908388","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:55.422Z","job_size_bytes":2506,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-5602aa1af82e8926b7ffb530: start","job_status":"start","queue_duration_s":0.3846,"scheduling_latency_s":0.384642}1766gitlab # [ 209.069836] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:55.964Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","f2d49b92a65b0a3ed40a5884"],"class":"WebHooks::LogExecutionWorker","jid":"5602aa1af82e8926b7ffb530","created_at":"2026-07-06T10:41:55.416Z","trace_propagation_headers":{"sentry-trace":"73a85f8f64e249a9a4463ed5f3b112ae-148c50f16c554e62","baggage":"sentry-trace_id=73a85f8f64e249a9a4463ed5f3b112ae,sentry-release=Unknown"},"correlation_id":"01KWVGAAJTAMKABKTJAN50HZ7J","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9cbf3b55981bee867fe99591b7b0d3df2514959b509d835a05b3c0968f908388","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:55.422Z","job_size_bytes":2506,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-5602aa1af82e8926b7ffb530: done: 0.157021 sec","job_status":"done","queue_duration_s":0.3846,"scheduling_latency_s":0.384642,"redis_calls":10,"redis_duration_s":0.003554,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000699,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002262,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000593,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.027,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.027,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000550908,"duration_s":0.157021,"completed_at":"2026-07-06T10:41:55.964Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1767gitlab # [ 209.075406] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:55.966Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"105bc0603635e4c08ec4683e","created_at":"2026-07-06T10:41:55.459Z","trace_propagation_headers":{"sentry-trace":"d6a515556caf4d59a80d1f1bc9490725-28e3d1bdde2c4720","baggage":"sentry-trace_id=d6a515556caf4d59a80d1f1bc9490725,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGAC5F8KXPXWZ4RQJWR49M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:55.465Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-105bc0603635e4c08ec4683e: start","job_status":"start","queue_duration_s":0.500573,"scheduling_latency_s":0.500596}1768gitlab # [ 209.312969] gitaly[1383]: time="2026-07-06T10:41:56.207Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAC5F8KXPXWZ4RQJWR49M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-06T10:42:26.104" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:56.205" grpc.time_ms=1.405 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses1770gitlab # [ 209.434801] gitaly[1383]: time="2026-07-06T10:41:56.329Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAC5F8KXPXWZ4RQJWR49M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:26.223" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:56.324" grpc.time_ms=3.897 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 209.481802] gitaly[1383]: time="2026-07-06T10:41:56.376Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGADKB5GSCENGFTQ33RYQ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:26.274" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:56.375" grpc.time_ms=1.219 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772gitlab # [ 209.534613] gitaly[1383]: time="2026-07-06T10:41:56.429Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAC5F8KXPXWZ4RQJWR49M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:26.327" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:56.427" grpc.time_ms=1.489 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 209.553158] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:56.446Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"105bc0603635e4c08ec4683e","created_at":"2026-07-06T10:41:55.459Z","trace_propagation_headers":{"sentry-trace":"d6a515556caf4d59a80d1f1bc9490725-28e3d1bdde2c4720","baggage":"sentry-trace_id=d6a515556caf4d59a80d1f1bc9490725,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGAC5F8KXPXWZ4RQJWR49M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:55.465Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-105bc0603635e4c08ec4683e: done: 0.48036 sec","job_status":"done","queue_duration_s":0.500573,"scheduling_latency_s":0.500596,"gitaly_calls":3,"gitaly_duration_s":0.064203,"redis_calls":53,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.022894,"redis_read_bytes":235,"redis_write_bytes":7156,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002314,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.00584,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.00372,"redis_feature_flag_read_bytes":134,"redis_feature_flag_write_bytes":992,"redis_queues_calls":2,"redis_queues_duration_s":0.00057,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1131,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.003528,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":840,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001184,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":165,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.00113,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002294,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.211,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":22,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.187,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.182717,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.32208926,"duration_s":0.48036,"completed_at":"2026-07-06T10:41:56.446Z","load_balancing_strategy":"primary","db_duration_s":0.219969,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1774gitlab # [ 209.572447] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:56.451Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"83496e5b63e44968e2327ac1","created_at":"2026-07-06T10:41:56.186Z","trace_propagation_headers":{"sentry-trace":"d6a515556caf4d59a80d1f1bc9490725-313fde983bcb4d88","baggage":"sentry-trace_id=d6a515556caf4d59a80d1f1bc9490725,sentry-release=Unknown"},"correlation_id":"01KWVGAC5F8KXPXWZ4RQJWR49M","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:56.191Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-83496e5b63e44968e2327ac1: start","job_status":"start","queue_duration_s":0.260382,"scheduling_latency_s":0.260405}1775gitlab # [ 209.596661] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1361776gitlab # [ 209.600406] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:41:56.492Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"83496e5b63e44968e2327ac1","created_at":"2026-07-06T10:41:56.186Z","trace_propagation_headers":{"sentry-trace":"d6a515556caf4d59a80d1f1bc9490725-313fde983bcb4d88","baggage":"sentry-trace_id=d6a515556caf4d59a80d1f1bc9490725,sentry-release=Unknown"},"correlation_id":"01KWVGAC5F8KXPXWZ4RQJWR49M","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-06T10:41:56.191Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-83496e5b63e44968e2327ac1: done: 0.040874 sec","job_status":"done","queue_duration_s":0.260382,"scheduling_latency_s":0.260405,"redis_calls":10,"redis_duration_s":0.008518999999999999,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001154,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005291,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002074,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000799822,"duration_s":0.040874,"completed_at":"2026-07-06T10:41:56.492Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007816,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1777gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses, in 0.35 seconds)1778gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses1779gitlab # [ 210.841423] gitaly[1383]: time="2026-07-06T10:41:57.735Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAEXBPCNVW5DKKA59HKTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:27.132" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:57.733" grpc.time_ms=1.14 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1780gitlab # [ 210.869968] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 881781gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses, in 0.16 seconds)1782gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses1783gitlab # [ 212.013815] gitaly[1383]: time="2026-07-06T10:41:58.908Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAG1GSBGZ6KA86CK750VQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:28.305" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:41:58.906" grpc.time_ms=1.209 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1784gitlab # [ 212.042787] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:41:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1031785gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses, in 0.17 seconds)1786gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses1787gitlab # [ 213.173700] gitaly[1383]: time="2026-07-06T10:42:00.068Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAH64T90K2HBBJ8YTA808 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:30.065" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:00.066" grpc.time_ms=1.061 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1788gitlab # [ 213.214314] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:42:00 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1031789gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses, in 0.16 seconds)1790gitlab # [ 214.049922] nix-daemon[3433]: accepted connection from pid 3471, user nixbot1791gitlab # [ 214.100252] gitaly[1383]: time="2026-07-06T10:42:00.995Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAJ30CH38JG3X0M8HSAJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:30.892" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:00.993" grpc.time_ms=1.224 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 214.164921] gitaly[1383]: time="2026-07-06T10:42:01.059Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAJ30CH38JG3X0M8HSAJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:42:11.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:42:01.052" grpc.time_ms=7.292 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1793gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses1794gitlab # [ 214.235255] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.128Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e9b911d0d838545d98f0f90a","created_at":"2026-07-06T10:42:01.117Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-798e104837024336","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.125Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e9b911d0d838545d98f0f90a: start","job_status":"start","queue_duration_s":0.003526,"scheduling_latency_s":0.003598}1795gitlab # [ 214.263895] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:42:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d85f2b79a773d93928eac516779bae28bee028ab HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 2281796gitlab # [ 214.265879] nixbot[3118]: {"ts": "2026-07-06T10:42:01.159Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d85f2b79a773d93928eac516779bae28bee028ab \"HTTP/1.1 201 Created\""}1797gitlab # [ 214.316431] gitaly[1383]: time="2026-07-06T10:42:01.211Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAJABS2WQN2E1X4EQSEK0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:31.109" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:01.210" grpc.time_ms=0.779 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 214.340343] gitaly[1383]: time="2026-07-06T10:42:01.235Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAJB576DY8RM3RJ0BK1ZC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:31.134" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:01.234" grpc.time_ms=0.525 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 214.360046] gitaly[1383]: time="2026-07-06T10:42:01.248Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAJABS2WQN2E1X4EQSEK0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:42:11.190" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:42:01.240" grpc.time_ms=8.084 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses, in 0.15 seconds)1801gitlab # [ 214.380739] gitaly[1383]: time="2026-07-06T10:42:01.269Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGAJ30CH38JG3X0M8HSAJS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:42:01.268" grpc.time_ms=1.028 pid=1383 span.kind=server system=grpc1802gitlab # [ 214.395821] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:42:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses HTTP/1.1" 200 671 "" "curl/8.20.0" 741803gitlab # [ 214.405810] gitaly[1383]: time="2026-07-06T10:42:01.300Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGAJ30CH38JG3X0M8HSAJS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:42:01.300" grpc.time_ms=0.393 pid=1383 span.kind=server system=grpc1804gitlab # [ 214.418206] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:42:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d85f2b79a773d93928eac516779bae28bee028ab HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1491805gitlab # [ 214.419534] nixbot[3118]: {"ts": "2026-07-06T10:42:01.314Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d85f2b79a773d93928eac516779bae28bee028ab \"HTTP/1.1 201 Created\""}1806gitlab # [ 214.452710] gitaly[1383]: time="2026-07-06T10:42:01.347Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGAJ30CH38JG3X0M8HSAJS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:42:01.347" grpc.time_ms=0.438 pid=1383 span.kind=server system=grpc1807gitlab # [ 214.477526] gitaly[1383]: time="2026-07-06T10:42:01.372Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAJ30CH38JG3X0M8HSAJS diskcache=b2ad2b24-12d6-4f5f-b0d4-beb8dbbb05a2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-06T10:42:31.138" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:42:01.238" pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab # [ 214.492849] gitaly[1383]: time="2026-07-06T10:42:01.387Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=104 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7240 command.oublock=0 command.real_time_ms=124 command.spawn_token_fork_ms=0 command.system_time_ms=75 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAJ30CH38JG3X0M8HSAJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-06T10:42:31.138" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:42:01.238" grpc.time_ms=134.134 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1809gitlab # [ 214.563239] gitaly[1383]: time="2026-07-06T10:42:01.458Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAJ30CH38JG3X0M8HSAJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-06T10:42:31.356" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:01.456" grpc.time_ms=1.229 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab # [ 214.638808] gitaly[1383]: time="2026-07-06T10:42:01.533Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAJ30CH38JG3X0M8HSAJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:31.031" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:01.532" grpc.time_ms=1.411 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 214.721224] gitaly[1383]: time="2026-07-06T10:42:01.616Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAJ30CH38JG3X0M8HSAJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:31.113" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:01.614" grpc.time_ms=1.306 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1812gitlab # [ 214.767795] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.634Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"19ff016c05fbd65d02773ffb","created_at":"2026-07-06T10:42:01.629Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"e9b911d0d838545d98f0f90a","job_size_bytes":3,"pid":2114,"job_status":"deduplicated","message":"PipelineProcessWorker JID-19ff016c05fbd65d02773ffb: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1813gitlab # [ 214.770532] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.638Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e9b911d0d838545d98f0f90a","created_at":"2026-07-06T10:42:01.117Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-798e104837024336","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.125Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2114,"job_status":"rescheduled","message":"PipelineProcessWorker JID-e9b911d0d838545d98f0f90a: rescheduled"}1814gitlab # [ 214.772716] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.652Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e9b911d0d838545d98f0f90a","created_at":"2026-07-06T10:42:01.117Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-798e104837024336","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.125Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e9b911d0d838545d98f0f90a: done: 0.524219 sec","job_status":"done","queue_duration_s":0.003526,"scheduling_latency_s":0.003598,"gitaly_calls":4,"gitaly_duration_s":0.192546,"redis_calls":117,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.051655,"redis_read_bytes":281,"redis_write_bytes":27406,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00156,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.005966,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_feature_flag_calls":26,"redis_feature_flag_duration_s":0.009516,"redis_feature_flag_read_bytes":26,"redis_feature_flag_write_bytes":4583,"redis_queues_calls":25,"redis_queues_duration_s":0.006858,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14465,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.019328,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000663,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000969,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005235,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":851,"db_count":49,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":49,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.013,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.245231,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.457895347,"duration_s":0.524219,"completed_at":"2026-07-06T10:42:01.652Z","load_balancing_strategy":"primary","db_duration_s":0.058319,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1815gitlab # [ 214.855758] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.656Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"74b5e026929930da76c80f0a","created_at":"2026-07-06T10:42:01.211Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.225Z","job_size_bytes":23,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-74b5e026929930da76c80f0a: start","job_status":"start","queue_duration_s":0.4313,"scheduling_latency_s":0.431352}1816gitlab # [ 214.857505] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.737Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"74b5e026929930da76c80f0a","created_at":"2026-07-06T10:42:01.211Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.225Z","job_size_bytes":23,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-74b5e026929930da76c80f0a: done: 0.081623 sec","job_status":"done","queue_duration_s":0.4313,"scheduling_latency_s":0.431352,"redis_calls":10,"redis_duration_s":0.005078,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001004,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00297,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001104,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000557613,"duration_s":0.081623,"completed_at":"2026-07-06T10:42:01.737Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01959,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1817gitlab # [ 214.945606] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.740Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f594626e41b37871ad79a3e4","created_at":"2026-07-06T10:42:01.393Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.397Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f594626e41b37871ad79a3e4: start","job_status":"start","queue_duration_s":0.34217,"scheduling_latency_s":0.342192}1818gitlab # [ 214.951621] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.770Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f594626e41b37871ad79a3e4","created_at":"2026-07-06T10:42:01.393Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.397Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f594626e41b37871ad79a3e4: done: 0.030602 sec","job_status":"done","queue_duration_s":0.34217,"scheduling_latency_s":0.342192,"redis_calls":10,"redis_duration_s":0.004661,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001107,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002599,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000588901,"duration_s":0.030602,"completed_at":"2026-07-06T10:42:01.770Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005998,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1819gitlab # [ 215.037582] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.772Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"43453d4de0a08b5646f51463","created_at":"2026-07-06T10:42:01.410Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.414Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-43453d4de0a08b5646f51463: start","job_status":"start","queue_duration_s":0.357891,"scheduling_latency_s":0.35791}1820gitlab # [ 215.045508] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.808Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"43453d4de0a08b5646f51463","created_at":"2026-07-06T10:42:01.410Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.414Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-43453d4de0a08b5646f51463: done: 0.036424 sec","job_status":"done","queue_duration_s":0.357891,"scheduling_latency_s":0.35791,"redis_calls":10,"redis_duration_s":0.004092,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000775,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00251,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000807,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000612369,"duration_s":0.036424,"completed_at":"2026-07-06T10:42:01.808Z","load_balancing_strategy":"primary","db_duration_s":0.010451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1821gitlab # [ 215.146494] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.810Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2f7bc8d0626033be420eabce","created_at":"2026-07-06T10:42:01.427Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.431Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2f7bc8d0626033be420eabce: start","job_status":"start","queue_duration_s":0.378971,"scheduling_latency_s":0.378992}1822gitlab # [ 215.148912] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.858Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2f7bc8d0626033be420eabce","created_at":"2026-07-06T10:42:01.427Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.431Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2f7bc8d0626033be420eabce: done: 0.04746 sec","job_status":"done","queue_duration_s":0.378971,"scheduling_latency_s":0.378992,"redis_calls":13,"redis_duration_s":0.006138,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000834,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00245,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001916,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000802616,"duration_s":0.04746,"completed_at":"2026-07-06T10:42:01.858Z","load_balancing_strategy":"primary","db_duration_s":0.006346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1823gitlab # [ 215.246173] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.860Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"796694a085bf5082a3f1b126","created_at":"2026-07-06T10:42:01.432Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.436Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-796694a085bf5082a3f1b126: start","job_status":"start","queue_duration_s":0.424613,"scheduling_latency_s":0.424652}1824gitlab # [ 215.247935] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.894Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"796694a085bf5082a3f1b126","created_at":"2026-07-06T10:42:01.432Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.436Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-796694a085bf5082a3f1b126: done: 0.034206 sec","job_status":"done","queue_duration_s":0.424613,"scheduling_latency_s":0.424652,"redis_calls":10,"redis_duration_s":0.003264,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000598,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001911,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000755,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005456,"duration_s":0.034206,"completed_at":"2026-07-06T10:42:01.894Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1825gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses1826gitlab # [ 215.346191] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.896Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"176397ed479997169f7e4da9","created_at":"2026-07-06T10:42:01.436Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.441Z","job_size_bytes":19,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-176397ed479997169f7e4da9: start","job_status":"start","queue_duration_s":0.455207,"scheduling_latency_s":0.455228}1827gitlab # [ 215.347951] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.925Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"176397ed479997169f7e4da9","created_at":"2026-07-06T10:42:01.436Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.441Z","job_size_bytes":19,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-176397ed479997169f7e4da9: done: 0.0289 sec","job_status":"done","queue_duration_s":0.455207,"scheduling_latency_s":0.455228,"redis_calls":11,"redis_duration_s":0.003563,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000621,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002264,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000678,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000425473,"duration_s":0.0289,"completed_at":"2026-07-06T10:42:01.925Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005344,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1828gitlab # [ 215.444873] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.927Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"09a83aafd928dba4e2f67f14","created_at":"2026-07-06T10:42:01.444Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.448Z","job_size_bytes":66,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-09a83aafd928dba4e2f67f14: start","job_status":"start","queue_duration_s":0.479139,"scheduling_latency_s":0.47916}1829gitlab # [ 215.446128] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.955Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"09a83aafd928dba4e2f67f14","created_at":"2026-07-06T10:42:01.444Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.448Z","job_size_bytes":66,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-09a83aafd928dba4e2f67f14: done: 0.028283 sec","job_status":"done","queue_duration_s":0.479139,"scheduling_latency_s":0.47916,"redis_calls":10,"redis_duration_s":0.00435,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000761,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002557,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000599238,"duration_s":0.028283,"completed_at":"2026-07-06T10:42:01.955Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005511,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1830gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses, in 0.19 seconds)1831gitlab # [ 215.517579] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.957Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"02260eccda6bd67cdd94b9dc","created_at":"2026-07-06T10:42:01.449Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.450Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-02260eccda6bd67cdd94b9dc: start","job_status":"start","queue_duration_s":0.506912,"scheduling_latency_s":0.506933}1832gitlab # [ 215.518784] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.986Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"02260eccda6bd67cdd94b9dc","created_at":"2026-07-06T10:42:01.449Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.450Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-02260eccda6bd67cdd94b9dc: done: 0.028855 sec","job_status":"done","queue_duration_s":0.506912,"scheduling_latency_s":0.506933,"redis_calls":7,"redis_duration_s":0.003485,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000784,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028855,"completed_at":"2026-07-06T10:42:01.986Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005481,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1833gitlab # [ 215.586872] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:01.988Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"749056bf2fc110512ecce23f","created_at":"2026-07-06T10:42:01.548Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.556Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-749056bf2fc110512ecce23f: start","job_status":"start","queue_duration_s":0.431784,"scheduling_latency_s":0.431807}1834gitlab # [ 215.606435] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:02.026Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"749056bf2fc110512ecce23f","created_at":"2026-07-06T10:42:01.548Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.556Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-749056bf2fc110512ecce23f: done: 0.038469 sec","job_status":"done","queue_duration_s":0.431784,"scheduling_latency_s":0.431807,"redis_calls":10,"redis_duration_s":0.004363,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00096,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000767,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000619073,"duration_s":0.038469,"completed_at":"2026-07-06T10:42:02.026Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013553,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1835gitlab # [ 215.739129] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:02.028Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9bbb8ee8cfd9d2795d725356","created_at":"2026-07-06T10:42:01.558Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.567Z","job_size_bytes":6,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9bbb8ee8cfd9d2795d725356: start","job_status":"start","queue_duration_s":0.460738,"scheduling_latency_s":0.460759}1836gitlab # [ 215.740831] gitaly[1383]: time="2026-07-06T10:42:02.156Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAJ30CH38JG3X0M8HSAJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-06T10:42:32.054" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:02.155" grpc.time_ms=1.563 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1837gitlab # [ 215.741991] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:42:02 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 621838gitlab # [ 215.742813] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:02.056Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9bbb8ee8cfd9d2795d725356","created_at":"2026-07-06T10:42:01.558Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.567Z","job_size_bytes":6,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9bbb8ee8cfd9d2795d725356: done: 0.028031 sec","job_status":"done","queue_duration_s":0.460738,"scheduling_latency_s":0.460759,"redis_calls":10,"redis_duration_s":0.006102,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002827,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002429,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000846,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000540293,"duration_s":0.028031,"completed_at":"2026-07-06T10:42:02.056Z","load_balancing_strategy":"primary","db_duration_s":0.003977,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1839gitlab # [ 215.820112] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:02.058Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3f9ee6373434ba737d8a8019","created_at":"2026-07-06T10:42:01.569Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.575Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3f9ee6373434ba737d8a8019: start","job_status":"start","queue_duration_s":0.483366,"scheduling_latency_s":0.483386}1840gitlab # [ 215.821112] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:02.088Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3f9ee6373434ba737d8a8019","created_at":"2026-07-06T10:42:01.569Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.575Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3f9ee6373434ba737d8a8019: done: 0.029568 sec","job_status":"done","queue_duration_s":0.483366,"scheduling_latency_s":0.483386,"redis_calls":10,"redis_duration_s":0.003453,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000833,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00192,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0007,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000339429,"duration_s":0.029568,"completed_at":"2026-07-06T10:42:02.088Z","load_balancing_strategy":"primary","db_duration_s":0.0058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1841gitlab # [ 215.906943] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:02.089Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"32f911afa3e3298a510e6c5f","created_at":"2026-07-06T10:42:01.640Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.642Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-32f911afa3e3298a510e6c5f: start","job_status":"start","queue_duration_s":0.446764,"scheduling_latency_s":0.446785}1842gitlab # [ 215.908236] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:02.233Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"32f911afa3e3298a510e6c5f","created_at":"2026-07-06T10:42:01.640Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-f5cc61f4cf16480d","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:01.642Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-32f911afa3e3298a510e6c5f: done: 0.144175 sec","job_status":"done","queue_duration_s":0.446764,"scheduling_latency_s":0.446785,"gitaly_calls":3,"gitaly_duration_s":0.010771,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.013094,"redis_read_bytes":98,"redis_write_bytes":6014,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001625,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.003431,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000541,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002825,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000553,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000932,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001562,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":20,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081484,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11921599,"duration_s":0.144175,"completed_at":"2026-07-06T10:42:02.233Z","load_balancing_strategy":"primary","db_duration_s":0.047084,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1843gitlab # [ 215.989274] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:02.236Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"6975eb4212570e114dddffc2","created_at":"2026-07-06T10:42:02.142Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-0933bcbaa7c14c6e","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:02.144Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6975eb4212570e114dddffc2: start","job_status":"start","queue_duration_s":0.092218,"scheduling_latency_s":0.092241}1844gitlab # [ 216.003212] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:02.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"6975eb4212570e114dddffc2","created_at":"2026-07-06T10:42:02.142Z","trace_propagation_headers":{"sentry-trace":"5b0ac9446cab4a038acffa3865018488-0933bcbaa7c14c6e","baggage":"sentry-trace_id=5b0ac9446cab4a038acffa3865018488,sentry-release=Unknown"},"correlation_id":"01KWVGAJ30CH38JG3X0M8HSAJS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:02.144Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6975eb4212570e114dddffc2: done: 0.027676 sec","job_status":"done","queue_duration_s":0.092218,"scheduling_latency_s":0.092241,"redis_calls":7,"redis_duration_s":0.0023439999999999997,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00138,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027676,"completed_at":"2026-07-06T10:42:02.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1845gitlab # [ 216.075619] gitaly[1383]: time="2026-07-06T10:42:02.186Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAJ30CH38JG3X0M8HSAJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:32.085" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:02.185" grpc.time_ms=0.693 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1846gitlab # [ 216.148175] gitaly[1383]: time="2026-07-06T10:42:02.220Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAJ30CH38JG3X0M8HSAJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:32.118" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:02.219" grpc.time_ms=0.888 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1847gitlab # [ 216.149382] gitaly[1383]: time="2026-07-06T10:42:02.449Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAKH35KCTFB3A3SV2NY6G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:32.347" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:02.448" grpc.time_ms=0.691 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1848gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses1849gitlab # [ 216.707435] gitaly[1383]: time="2026-07-06T10:42:03.602Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAMKZE0VSNS1KZ6NFQ0GH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:33.499" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:03.600" grpc.time_ms=1.646 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1850gitlab # [ 216.729763] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:03.623Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1eb2ac5d031d61ad8fab2389","created_at":"2026-07-06T10:42:03.599Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"864e5415a3155373f377cdd39f40c43e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.618Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1eb2ac5d031d61ad8fab2389: start","job_status":"start","queue_duration_s":0.004599,"scheduling_latency_s":0.004646}1851gitlab # [ 216.782359] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:42:03 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 1561852gitlab # [ 216.785872] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:03.677Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1853gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses, in 0.22 seconds)1854gitlab # [ 216.803963] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:03.698Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1eb2ac5d031d61ad8fab2389","created_at":"2026-07-06T10:42:03.599Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"864e5415a3155373f377cdd39f40c43e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.618Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1eb2ac5d031d61ad8fab2389: done: 0.075272 sec","job_status":"done","queue_duration_s":0.004599,"scheduling_latency_s":0.004646,"redis_calls":9,"redis_duration_s":0.017329999999999998,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002819,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.007708,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.075272,"completed_at":"2026-07-06T10:42:03.698Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008265,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1855gitlab # [ 216.823877] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:03.718Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a2640353b1d3b14aa5ba7860","created_at":"2026-07-06T10:42:03.642Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6de1367187162d19c0c01d2e835a58a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.657Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a2640353b1d3b14aa5ba7860: start","job_status":"start","queue_duration_s":0.061387,"scheduling_latency_s":0.06142}1856gitlab # [ 217.643113] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a2640353b1d3b14aa5ba7860","created_at":"2026-07-06T10:42:03.642Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6de1367187162d19c0c01d2e835a58a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.657Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a2640353b1d3b14aa5ba7860: done: 0.818997 sec","job_status":"done","queue_duration_s":0.061387,"scheduling_latency_s":0.06142,"redis_calls":573,"redis_duration_s":0.463626,"redis_read_bytes":571,"redis_write_bytes":49790,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001398,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.460057,"redis_shared_state_read_bytes":565,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.400257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.818997,"completed_at":"2026-07-06T10:42:04.537Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004487,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1857gitlab # [ 217.709451] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"6b12aa243ef71ead0a2a7516","created_at":"2026-07-06T10:42:03.663Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1facc5287f90d0aa6e84b8821bcce9f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.672Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-6b12aa243ef71ead0a2a7516: start","job_status":"start","queue_duration_s":0.93209,"scheduling_latency_s":0.932128}1858gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses1859gitlab # [ 217.870445] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.764Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"6b12aa243ef71ead0a2a7516","created_at":"2026-07-06T10:42:03.663Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1facc5287f90d0aa6e84b8821bcce9f8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.672Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-6b12aa243ef71ead0a2a7516: done: 0.160234 sec","job_status":"done","queue_duration_s":0.93209,"scheduling_latency_s":0.932128,"redis_calls":12,"redis_duration_s":0.006529,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001154,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002612,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002763,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.11524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001454095,"exclusive_lock_hold_duration_s":0.109467824,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.160234,"completed_at":"2026-07-06T10:42:04.764Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012652,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1860gitlab # [ 217.875260] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.766Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a30dd9f3da8d5341bfce9df1","created_at":"2026-07-06T10:42:03.688Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d3180e5c4cac7196a17474a4c5fb613","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.696Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a30dd9f3da8d5341bfce9df1: start","job_status":"start","queue_duration_s":1.07013,"scheduling_latency_s":1.070152}1861gitlab # [ 217.977255] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.786Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a30dd9f3da8d5341bfce9df1","created_at":"2026-07-06T10:42:03.688Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d3180e5c4cac7196a17474a4c5fb613","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.696Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a30dd9f3da8d5341bfce9df1: done: 0.019585 sec","job_status":"done","queue_duration_s":1.07013,"scheduling_latency_s":1.070152,"redis_calls":9,"redis_duration_s":0.003889,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000915,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000803,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019585,"completed_at":"2026-07-06T10:42:04.786Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002679,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1862gitlab # [ 217.981227] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.787Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"876be64bad0119fe0a7e659a","created_at":"2026-07-06T10:42:03.719Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1e662bbc41c2204d733be424e3f2881","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-06T10:42:03.729Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-876be64bad0119fe0a7e659a: start","job_status":"start","queue_duration_s":1.058014,"scheduling_latency_s":1.058035}1863gitlab # [ 218.001952] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.814Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"876be64bad0119fe0a7e659a","created_at":"2026-07-06T10:42:03.719Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1e662bbc41c2204d733be424e3f2881","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-06T10:42:03.729Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-876be64bad0119fe0a7e659a: done: 0.02659 sec","job_status":"done","queue_duration_s":1.058014,"scheduling_latency_s":1.058035,"redis_calls":11,"redis_duration_s":0.004948,"redis_read_bytes":9,"redis_write_bytes":1345,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001623,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":604,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002337,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02659,"completed_at":"2026-07-06T10:42:04.814Z","load_balancing_strategy":"primary","db_duration_s":0.004674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1864gitlab # [ 218.069175] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.816Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"7cc25f4979d5f876c4b5d2b1","created_at":"2026-07-06T10:42:03.738Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8855e68c2203b04bddf4b222a74f98c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.745Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-7cc25f4979d5f876c4b5d2b1: start","job_status":"start","queue_duration_s":1.070363,"scheduling_latency_s":1.070417}1865gitlab # [ 218.142433] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.827Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1866gitlab # [ 218.142819] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.832Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"7cc25f4979d5f876c4b5d2b1","created_at":"2026-07-06T10:42:03.738Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8855e68c2203b04bddf4b222a74f98c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.745Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-7cc25f4979d5f876c4b5d2b1: done: 0.016034 sec","job_status":"done","queue_duration_s":1.070363,"scheduling_latency_s":1.070417,"redis_calls":9,"redis_duration_s":0.0033929999999999997,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00063,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002031,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000732,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016034,"completed_at":"2026-07-06T10:42:04.832Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000814,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1867gitlab # [ 218.155843] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.834Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"81baa89288827bb61eccbae1","created_at":"2026-07-06T10:42:03.753Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a9b09a371893f6a59e63fdd878715c8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.759Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-81baa89288827bb61eccbae1: start","job_status":"start","queue_duration_s":1.075546,"scheduling_latency_s":1.075567}1868gitlab # [ 218.223614] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.845Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1869gitlab # [ 218.225133] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.850Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"81baa89288827bb61eccbae1","created_at":"2026-07-06T10:42:03.753Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a9b09a371893f6a59e63fdd878715c8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.759Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-81baa89288827bb61eccbae1: done: 0.015257 sec","job_status":"done","queue_duration_s":1.075546,"scheduling_latency_s":1.075567,"redis_calls":9,"redis_duration_s":0.00296,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000614,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001629,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000717,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015257,"completed_at":"2026-07-06T10:42:04.850Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1870gitlab # [ 218.304211] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.851Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"07b971617580914af62214eb","created_at":"2026-07-06T10:42:03.776Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8d768a861ceb7e84ed3026beb75a602","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.783Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-07b971617580914af62214eb: start","job_status":"start","queue_duration_s":1.068053,"scheduling_latency_s":1.068074}1871gitlab # [ 218.305652] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.869Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"07b971617580914af62214eb","created_at":"2026-07-06T10:42:03.776Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8d768a861ceb7e84ed3026beb75a602","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.783Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-07b971617580914af62214eb: done: 0.018083 sec","job_status":"done","queue_duration_s":1.068053,"scheduling_latency_s":1.068074,"redis_calls":12,"redis_duration_s":0.004307,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000607,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002274,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001426,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044419,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.018083,"completed_at":"2026-07-06T10:42:04.869Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000584,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1872gitlab # [ 218.374319] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.871Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"5e47980eb76f82e5d02a23de","created_at":"2026-07-06T10:42:03.790Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12ec4de1d37827898e89d58b46fde537","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.797Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-5e47980eb76f82e5d02a23de: start","job_status":"start","queue_duration_s":1.074013,"scheduling_latency_s":1.074032}1873gitlab # [ 218.376060] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.881Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1874gitlab # [ 218.376879] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.885Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"5e47980eb76f82e5d02a23de","created_at":"2026-07-06T10:42:03.790Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12ec4de1d37827898e89d58b46fde537","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.797Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-5e47980eb76f82e5d02a23de: done: 0.014273 sec","job_status":"done","queue_duration_s":1.074013,"scheduling_latency_s":1.074032,"redis_calls":9,"redis_duration_s":0.002101,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000525,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001139,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008647,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014273,"completed_at":"2026-07-06T10:42:04.885Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000509,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1875gitlab # [ 218.449946] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"c1b2546a5e0de8ac5e94face","created_at":"2026-07-06T10:42:03.803Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3103993787670ece797f2c21c8423767","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.809Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-c1b2546a5e0de8ac5e94face: start","job_status":"start","queue_duration_s":1.077203,"scheduling_latency_s":1.077224}1876gitlab # [ 218.452362] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"c1b2546a5e0de8ac5e94face","created_at":"2026-07-06T10:42:03.803Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3103993787670ece797f2c21c8423767","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.809Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-c1b2546a5e0de8ac5e94face: done: 0.021854 sec","job_status":"done","queue_duration_s":1.077203,"scheduling_latency_s":1.077224,"redis_calls":10,"redis_duration_s":0.002483,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000503,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001369,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000611,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000339428,"duration_s":0.021854,"completed_at":"2026-07-06T10:42:04.908Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1877gitlab # [ 218.519087] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2fde89b5d1504f8e2e4efcda","created_at":"2026-07-06T10:42:03.816Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1246d2966bdd26674694ef1d7108de9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.822Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2fde89b5d1504f8e2e4efcda: start","job_status":"start","queue_duration_s":1.087426,"scheduling_latency_s":1.087446}1878gitlab # [ 218.597305] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.926Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2fde89b5d1504f8e2e4efcda","created_at":"2026-07-06T10:42:03.816Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1246d2966bdd26674694ef1d7108de9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.822Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2fde89b5d1504f8e2e4efcda: done: 0.0167 sec","job_status":"done","queue_duration_s":1.087426,"scheduling_latency_s":1.087446,"redis_calls":11,"redis_duration_s":0.002812,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000461,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001292,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000482743,"exclusive_lock_hold_duration_s":0.002001092,"duration_s":0.0167,"completed_at":"2026-07-06T10:42:04.926Z","load_balancing_strategy":"primary","db_duration_s":0.001226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1879gitlab # [ 218.599400] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.928Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ExpireBuildArtifactsWorker","jid":"0533f31625e04fc9b5773e65","created_at":"2026-07-06T10:42:03.833Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c63e6fd10e938af3eae1b7afb574688c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:7be9ea93da0bda6381b334cf2932692b41842a57ea0aeac11899369225b9bb7e","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.842Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ExpireBuildArtifactsWorker JID-0533f31625e04fc9b5773e65: start","job_status":"start","queue_duration_s":1.086203,"scheduling_latency_s":1.086223}1880gitlab # [ 218.666306] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.943Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ExpireBuildArtifactsWorker","jid":"0533f31625e04fc9b5773e65","created_at":"2026-07-06T10:42:03.833Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c63e6fd10e938af3eae1b7afb574688c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:7be9ea93da0bda6381b334cf2932692b41842a57ea0aeac11899369225b9bb7e","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.842Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ExpireBuildArtifactsWorker JID-0533f31625e04fc9b5773e65: done: 0.015341 sec","job_status":"done","queue_duration_s":1.086203,"scheduling_latency_s":1.086223,"redis_calls":10,"redis_duration_s":0.00237,"redis_read_bytes":9,"redis_write_bytes":1035,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000422,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001482,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000372953,"duration_s":0.015341,"completed_at":"2026-07-06T10:42:04.943Z","load_balancing_strategy":"primary","db_duration_s":0.000398,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1881gitlab # [ 218.745979] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.944Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"e3620b95b5ac899ffdb554f4","created_at":"2026-07-06T10:42:03.862Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a817f319d53053e0a340e0d27b7ca1f","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.872Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-e3620b95b5ac899ffdb554f4: start","job_status":"start","queue_duration_s":1.072664,"scheduling_latency_s":1.072683}1882gitlab # [ 218.747052] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.960Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"e3620b95b5ac899ffdb554f4","created_at":"2026-07-06T10:42:03.862Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a817f319d53053e0a340e0d27b7ca1f","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.872Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-e3620b95b5ac899ffdb554f4: done: 0.016122 sec","job_status":"done","queue_duration_s":1.072664,"scheduling_latency_s":1.072683,"redis_calls":12,"redis_duration_s":0.003089,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000569,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000427,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00144,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000653,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000375188,"duration_s":0.016122,"completed_at":"2026-07-06T10:42:04.960Z","load_balancing_strategy":"primary","db_duration_s":0.000341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1883gitlab # [ 218.825418] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.962Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"ef4685e8168dc78f2c8308ef","created_at":"2026-07-06T10:42:03.889Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f17af4977dea1393c11f053f17d8aa9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.897Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-ef4685e8168dc78f2c8308ef: start","job_status":"start","queue_duration_s":1.064392,"scheduling_latency_s":1.064456}1884gitlab # [ 218.826963] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.987Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"ef4685e8168dc78f2c8308ef","created_at":"2026-07-06T10:42:03.889Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f17af4977dea1393c11f053f17d8aa9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.897Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-ef4685e8168dc78f2c8308ef: done: 0.024744 sec","job_status":"done","queue_duration_s":1.064392,"scheduling_latency_s":1.064456,"redis_calls":18,"redis_duration_s":0.004474,"redis_read_bytes":20,"redis_write_bytes":4698,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000979,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000321,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.00241,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000764,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024744,"completed_at":"2026-07-06T10:42:04.986Z","load_balancing_strategy":"primary","db_duration_s":0.001963,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1885gitlab # [ 218.894350] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.988Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"02affe34bcd889cdff1e20ef","created_at":"2026-07-06T10:42:03.903Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34a0864b0edd182cef6d6b3b03bbfc44","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-06T10:42:03.910Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-02affe34bcd889cdff1e20ef: start","job_status":"start","queue_duration_s":1.077599,"scheduling_latency_s":1.077622}1886gitlab # [ 218.895778] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:04.999Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1887gitlab # [ 218.896858] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.004Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"02affe34bcd889cdff1e20ef","created_at":"2026-07-06T10:42:03.903Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34a0864b0edd182cef6d6b3b03bbfc44","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-06T10:42:03.910Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-02affe34bcd889cdff1e20ef: done: 0.016015 sec","job_status":"done","queue_duration_s":1.077599,"scheduling_latency_s":1.077622,"redis_calls":9,"redis_duration_s":0.004053,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000965,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002252,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000836,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016015,"completed_at":"2026-07-06T10:42:05.004Z","load_balancing_strategy":"primary","db_duration_s":0.000413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1888gitlab # [ 218.978498] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.006Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"df97f2be4fae0586be315e0b","created_at":"2026-07-06T10:42:03.917Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2467251df45201af0ba2c598f1ac40c9","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.925Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-df97f2be4fae0586be315e0b: start","job_status":"start","queue_duration_s":1.080506,"scheduling_latency_s":1.080527}1889gitlab # [ 218.979738] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.027Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"df97f2be4fae0586be315e0b","created_at":"2026-07-06T10:42:03.917Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2467251df45201af0ba2c598f1ac40c9","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.925Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-df97f2be4fae0586be315e0b: done: 0.021313 sec","job_status":"done","queue_duration_s":1.080506,"scheduling_latency_s":1.080527,"redis_calls":12,"redis_duration_s":0.0050409999999999995,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000834,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002515,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001692,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00326019,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.021313,"completed_at":"2026-07-06T10:42:05.027Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002182,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1890gitlab # [ 219.054487] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"5458f19cec0ef07c3b8e6f5e","created_at":"2026-07-06T10:42:03.941Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9f1006e9f930b551de18c7e97869c64","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.955Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-5458f19cec0ef07c3b8e6f5e: start","job_status":"start","queue_duration_s":1.073491,"scheduling_latency_s":1.073512}1891gitlab # [ 219.055762] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.084Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"5458f19cec0ef07c3b8e6f5e","created_at":"2026-07-06T10:42:03.941Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9f1006e9f930b551de18c7e97869c64","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.955Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-5458f19cec0ef07c3b8e6f5e: done: 0.055248 sec","job_status":"done","queue_duration_s":1.073491,"scheduling_latency_s":1.073512,"redis_calls":13,"redis_duration_s":0.005628,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001914,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002104,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00161,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001116622,"exclusive_lock_hold_duration_s":0.023578416,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.055248,"completed_at":"2026-07-06T10:42:05.084Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010692,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1892gitlab # [ 219.138364] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.086Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d853908bd2c630126856bf51","created_at":"2026-07-06T10:42:03.965Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5efdfeb5294910e881af5654e993deea","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.976Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d853908bd2c630126856bf51: start","job_status":"start","queue_duration_s":1.109871,"scheduling_latency_s":1.109894}1893gitlab # [ 219.140648] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.103Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d853908bd2c630126856bf51","created_at":"2026-07-06T10:42:03.965Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5efdfeb5294910e881af5654e993deea","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:03.976Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d853908bd2c630126856bf51: done: 0.016602 sec","job_status":"done","queue_duration_s":1.109871,"scheduling_latency_s":1.109894,"redis_calls":11,"redis_duration_s":0.002658,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000427,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001261,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000444749,"exclusive_lock_hold_duration_s":0.001575619,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.016602,"completed_at":"2026-07-06T10:42:05.103Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001183,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1894gitlab # [ 219.211065] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"dcadf9408714567df60c4bf8","created_at":"2026-07-06T10:42:03.996Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d436f8af140364abd593859fabcdcb74","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-06T10:42:04.008Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-dcadf9408714567df60c4bf8: start","job_status":"start","queue_duration_s":1.096516,"scheduling_latency_s":1.096535}1895gitlab # [ 219.279209] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.115Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1896gitlab # [ 219.280674] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.120Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"dcadf9408714567df60c4bf8","created_at":"2026-07-06T10:42:03.996Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d436f8af140364abd593859fabcdcb74","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-06T10:42:04.008Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-dcadf9408714567df60c4bf8: done: 0.01527 sec","job_status":"done","queue_duration_s":1.096516,"scheduling_latency_s":1.096535,"redis_calls":9,"redis_duration_s":0.003371,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000756,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001892,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000723,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01527,"completed_at":"2026-07-06T10:42:05.120Z","load_balancing_strategy":"primary","db_duration_s":0.000361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1897gitlab # [ 219.346163] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.121Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"18195fb63c02647560c0d847","created_at":"2026-07-06T10:42:04.038Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c751a7fefdb9479b82db580287bbb4d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.050Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-18195fb63c02647560c0d847: start","job_status":"start","queue_duration_s":1.071459,"scheduling_latency_s":1.071479}1898gitlab # [ 219.347177] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.139Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"18195fb63c02647560c0d847","created_at":"2026-07-06T10:42:04.038Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c751a7fefdb9479b82db580287bbb4d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.050Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-18195fb63c02647560c0d847: done: 0.018094 sec","job_status":"done","queue_duration_s":1.071459,"scheduling_latency_s":1.071479,"redis_calls":9,"redis_duration_s":0.0019520000000000002,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000413,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.018094,"completed_at":"2026-07-06T10:42:05.139Z","load_balancing_strategy":"primary","db_duration_s":0.004768,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1899gitlab # [ 219.416379] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.141Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ee7beaa88da1980c33887778","created_at":"2026-07-06T10:42:04.064Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff463928717bc2d530b5e3ca26cc6f97","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.073Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ee7beaa88da1980c33887778: start","job_status":"start","queue_duration_s":1.067317,"scheduling_latency_s":1.067338}1900gitlab # [ 219.417801] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.171Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ee7beaa88da1980c33887778","created_at":"2026-07-06T10:42:04.064Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff463928717bc2d530b5e3ca26cc6f97","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.073Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ee7beaa88da1980c33887778: done: 0.030355 sec","job_status":"done","queue_duration_s":1.067317,"scheduling_latency_s":1.067338,"redis_calls":11,"redis_duration_s":0.0032459999999999998,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000423,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001385,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001438,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048386,"exclusive_lock_hold_duration_s":0.009177982,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.030355,"completed_at":"2026-07-06T10:42:05.171Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010178,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1901gitlab # [ 219.484119] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.173Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3d2b2fc7152ea737bdbab8ea","created_at":"2026-07-06T10:42:04.083Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f720217dd30028ecf526c95958cc1959","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.092Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3d2b2fc7152ea737bdbab8ea: start","job_status":"start","queue_duration_s":1.080345,"scheduling_latency_s":1.080366}1902gitlab # [ 219.490307] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.190Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3d2b2fc7152ea737bdbab8ea","created_at":"2026-07-06T10:42:04.083Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f720217dd30028ecf526c95958cc1959","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.092Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3d2b2fc7152ea737bdbab8ea: done: 0.017456 sec","job_status":"done","queue_duration_s":1.080345,"scheduling_latency_s":1.080366,"redis_calls":11,"redis_duration_s":0.00328,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001281,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001491,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000508,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017456,"completed_at":"2026-07-06T10:42:05.190Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00066,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1903gitlab # [ 219.572934] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"d1effbcdf0b43fdff24248b2","created_at":"2026-07-06T10:42:04.106Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6438e8221be666f1042dbd0445e4cb7d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.115Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-d1effbcdf0b43fdff24248b2: start","job_status":"start","queue_duration_s":1.076154,"scheduling_latency_s":1.076175}1904gitlab # [ 219.576691] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.213Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"d1effbcdf0b43fdff24248b2","created_at":"2026-07-06T10:42:04.106Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6438e8221be666f1042dbd0445e4cb7d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.115Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-d1effbcdf0b43fdff24248b2: done: 0.02125 sec","job_status":"done","queue_duration_s":1.076154,"scheduling_latency_s":1.076175,"redis_calls":12,"redis_duration_s":0.002764,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00045,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001336,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00044,"exclusive_lock_hold_duration_s":0.0033702610000000003,"duration_s":0.02125,"completed_at":"2026-07-06T10:42:05.213Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1905gitlab # [ 219.663056] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.214Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"44803a64bf848ac63464f614","created_at":"2026-07-06T10:42:04.125Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab97701414a53f48e87a94d1da13a75f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.131Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-44803a64bf848ac63464f614: start","job_status":"start","queue_duration_s":1.083395,"scheduling_latency_s":1.083414}1906gitlab # [ 219.664283] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.230Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"44803a64bf848ac63464f614","created_at":"2026-07-06T10:42:04.125Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab97701414a53f48e87a94d1da13a75f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.131Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-44803a64bf848ac63464f614: done: 0.015444 sec","job_status":"done","queue_duration_s":1.083395,"scheduling_latency_s":1.083414,"redis_calls":9,"redis_duration_s":0.003108,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000656,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001825,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000627,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009398,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015444,"completed_at":"2026-07-06T10:42:05.230Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1907gitlab # [ 219.754992] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.231Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"37691d60131c3fc18fcad3b0","created_at":"2026-07-06T10:42:04.137Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"213c4241b2a5b30e103946842304a9ae","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.148Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-37691d60131c3fc18fcad3b0: start","job_status":"start","queue_duration_s":1.083229,"scheduling_latency_s":1.083251}1908gitlab # [ 219.756043] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.271Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"37691d60131c3fc18fcad3b0","created_at":"2026-07-06T10:42:04.137Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"213c4241b2a5b30e103946842304a9ae","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.148Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-37691d60131c3fc18fcad3b0: done: 0.04001 sec","job_status":"done","queue_duration_s":1.083229,"scheduling_latency_s":1.083251,"redis_calls":15,"redis_duration_s":0.005323,"redis_read_bytes":13,"redis_write_bytes":1859,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002901,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001794,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000628,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04001,"completed_at":"2026-07-06T10:42:05.271Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007746,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1909gitlab # [ 219.830305] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.273Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ea69764420f3e1d947dc9f8b","created_at":"2026-07-06T10:42:04.158Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2edf2e2c5b4a924dcb4139abd4a7b77a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.171Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ea69764420f3e1d947dc9f8b: start","job_status":"start","queue_duration_s":1.101586,"scheduling_latency_s":1.101616}1910gitlab # [ 219.831778] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ea69764420f3e1d947dc9f8b","created_at":"2026-07-06T10:42:04.158Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2edf2e2c5b4a924dcb4139abd4a7b77a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.171Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ea69764420f3e1d947dc9f8b: done: 0.162568 sec","job_status":"done","queue_duration_s":1.101586,"scheduling_latency_s":1.101616,"redis_calls":13,"redis_duration_s":0.003385,"redis_read_bytes":11,"redis_write_bytes":1567,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00096,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001201,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001224,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":125,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":125,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":125,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":80,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.119835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00054588,"exclusive_lock_hold_duration_s":0.142722609,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.162568,"completed_at":"2026-07-06T10:42:05.435Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.049232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1911gitlab # [ 219.898486] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"fb108da560b83b69f2975c4e","created_at":"2026-07-06T10:42:04.181Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.193Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-fb108da560b83b69f2975c4e: start","job_status":"start","queue_duration_s":1.244408,"scheduling_latency_s":1.24443}1912gitlab # [ 219.963530] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.522Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"fb108da560b83b69f2975c4e","created_at":"2026-07-06T10:42:04.181Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3539e5c661e146c1","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.193Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-fb108da560b83b69f2975c4e: done: 0.085002 sec","job_status":"done","queue_duration_s":1.244408,"scheduling_latency_s":1.24443,"redis_calls":70,"redis_duration_s":0.015134,"redis_read_bytes":118,"redis_write_bytes":42380,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002051,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000674,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37285,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.011783,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000626,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.085002,"completed_at":"2026-07-06T10:42:05.522Z","load_balancing_strategy":"primary","db_duration_s":0.001664,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1913gitlab # [ 220.030408] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.524Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8224081a5aa4e05592bb8365","created_at":"2026-07-06T10:42:04.973Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3bd4ffa6ce724241","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f17af4977dea1393c11f053f17d8aa9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.982Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8224081a5aa4e05592bb8365: start","job_status":"start","queue_duration_s":0.54175,"scheduling_latency_s":0.541778}1914gitlab # [ 220.031405] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.536Z","message":"No existing merge request to be cleaned up."}1915gitlab # [ 220.032258] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.543Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8224081a5aa4e05592bb8365","created_at":"2026-07-06T10:42:04.973Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3bd4ffa6ce724241","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f17af4977dea1393c11f053f17d8aa9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.982Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8224081a5aa4e05592bb8365: done: 0.019176 sec","job_status":"done","queue_duration_s":0.54175,"scheduling_latency_s":0.541778,"redis_calls":12,"redis_duration_s":0.002728,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000448,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001409,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019176,"completed_at":"2026-07-06T10:42:05.543Z","load_balancing_strategy":"primary","db_duration_s":0.002179,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1916gitlab # [ 220.123930] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.544Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8bf0d0d896cc78decc05bec2","created_at":"2026-07-06T10:42:04.973Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3bd4ffa6ce724241","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f17af4977dea1393c11f053f17d8aa9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.982Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8bf0d0d896cc78decc05bec2: start","job_status":"start","queue_duration_s":0.562182,"scheduling_latency_s":0.562202}1917gitlab # [ 220.125193] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.553Z","message":"No existing merge request to be cleaned up."}1918gitlab # [ 220.125955] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.559Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8bf0d0d896cc78decc05bec2","created_at":"2026-07-06T10:42:04.973Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3bd4ffa6ce724241","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f17af4977dea1393c11f053f17d8aa9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.982Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8bf0d0d896cc78decc05bec2: done: 0.015172 sec","job_status":"done","queue_duration_s":0.562182,"scheduling_latency_s":0.562202,"redis_calls":10,"redis_duration_s":0.002313,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001338,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015172,"completed_at":"2026-07-06T10:42:05.559Z","load_balancing_strategy":"primary","db_duration_s":0.001409,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1919gitlab # [ 220.198318] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.560Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a4a0ae66338472a3e75d1ef1","created_at":"2026-07-06T10:42:04.973Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3bd4ffa6ce724241","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f17af4977dea1393c11f053f17d8aa9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.982Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a4a0ae66338472a3e75d1ef1: start","job_status":"start","queue_duration_s":0.578574,"scheduling_latency_s":0.578595}1920gitlab # [ 220.199777] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.571Z","message":"No existing merge request to be cleaned up."}1921gitlab # [ 220.200885] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.578Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a4a0ae66338472a3e75d1ef1","created_at":"2026-07-06T10:42:04.973Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3bd4ffa6ce724241","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f17af4977dea1393c11f053f17d8aa9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.982Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a4a0ae66338472a3e75d1ef1: done: 0.017247 sec","job_status":"done","queue_duration_s":0.578574,"scheduling_latency_s":0.578595,"redis_calls":10,"redis_duration_s":0.002187,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001294,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017247,"completed_at":"2026-07-06T10:42:05.578Z","load_balancing_strategy":"primary","db_duration_s":0.004205,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1922gitlab # [ 220.278284] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.579Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"02406c7f6ee6a957ffad0cf8","created_at":"2026-07-06T10:42:04.973Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3bd4ffa6ce724241","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f17af4977dea1393c11f053f17d8aa9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.982Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-02406c7f6ee6a957ffad0cf8: start","job_status":"start","queue_duration_s":0.597094,"scheduling_latency_s":0.597114}1923gitlab # [ 220.279302] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.588Z","message":"No existing merge request to be cleaned up."}1924gitlab # [ 220.280150] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.594Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"02406c7f6ee6a957ffad0cf8","created_at":"2026-07-06T10:42:04.973Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-3bd4ffa6ce724241","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6f17af4977dea1393c11f053f17d8aa9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:04.982Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-02406c7f6ee6a957ffad0cf8: done: 0.015389 sec","job_status":"done","queue_duration_s":0.597094,"scheduling_latency_s":0.597114,"redis_calls":10,"redis_duration_s":0.002286,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001433,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015389,"completed_at":"2026-07-06T10:42:05.594Z","load_balancing_strategy":"primary","db_duration_s":0.001606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1925gitlab # [ 220.351965] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"396d4ad2bc3627871c2b08a1","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-396d4ad2bc3627871c2b08a1: start","job_status":"start","queue_duration_s":0.079982,"scheduling_latency_s":0.080002}1926gitlab # [ 220.352926] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"396d4ad2bc3627871c2b08a1","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-396d4ad2bc3627871c2b08a1: done: 0.020824 sec","job_status":"done","queue_duration_s":0.079982,"scheduling_latency_s":0.080002,"redis_calls":15,"redis_duration_s":0.003613,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000594,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020824,"completed_at":"2026-07-06T10:42:05.616Z","load_balancing_strategy":"primary","db_duration_s":0.000441,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1927gitlab # [ 220.446071] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcd537c5df6dd8ccc4b8dbdb","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcd537c5df6dd8ccc4b8dbdb: start","job_status":"start","queue_duration_s":0.10223,"scheduling_latency_s":0.102257}1928gitlab # [ 220.447160] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcd537c5df6dd8ccc4b8dbdb","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcd537c5df6dd8ccc4b8dbdb: done: 0.015122 sec","job_status":"done","queue_duration_s":0.10223,"scheduling_latency_s":0.102257,"redis_calls":13,"redis_duration_s":0.002792,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015122,"completed_at":"2026-07-06T10:42:05.633Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1929gitlab # [ 220.518925] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1a3abcc1bed3f3af69bf241","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1a3abcc1bed3f3af69bf241: start","job_status":"start","queue_duration_s":0.11858,"scheduling_latency_s":0.1186}1930gitlab # [ 220.520206] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1a3abcc1bed3f3af69bf241","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1a3abcc1bed3f3af69bf241: done: 0.016257 sec","job_status":"done","queue_duration_s":0.11858,"scheduling_latency_s":0.1186,"redis_calls":13,"redis_duration_s":0.003058,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016257,"completed_at":"2026-07-06T10:42:05.650Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1931gitlab # [ 220.591987] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f0584e585d3b9a07f1f4b79","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f0584e585d3b9a07f1f4b79: start","job_status":"start","queue_duration_s":0.136193,"scheduling_latency_s":0.136217}1932gitlab # [ 220.593056] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f0584e585d3b9a07f1f4b79","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f0584e585d3b9a07f1f4b79: done: 0.015253 sec","job_status":"done","queue_duration_s":0.136193,"scheduling_latency_s":0.136217,"redis_calls":13,"redis_duration_s":0.003139,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002273,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015253,"completed_at":"2026-07-06T10:42:05.667Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1933gitlab # [ 220.666757] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f227c62c1d8ac4a88a0d9ed6","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f227c62c1d8ac4a88a0d9ed6: start","job_status":"start","queue_duration_s":0.15265,"scheduling_latency_s":0.152671}1934gitlab # [ 220.668109] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f227c62c1d8ac4a88a0d9ed6","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f227c62c1d8ac4a88a0d9ed6: done: 0.01637 sec","job_status":"done","queue_duration_s":0.15265,"scheduling_latency_s":0.152671,"redis_calls":13,"redis_duration_s":0.0030419999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01637,"completed_at":"2026-07-06T10:42:05.684Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1935gitlab # [ 220.738232] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baf99be68e9d21e047d7aa62","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baf99be68e9d21e047d7aa62: start","job_status":"start","queue_duration_s":0.170445,"scheduling_latency_s":0.17047}1936gitlab # [ 220.739938] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baf99be68e9d21e047d7aa62","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baf99be68e9d21e047d7aa62: done: 0.015273 sec","job_status":"done","queue_duration_s":0.170445,"scheduling_latency_s":0.17047,"redis_calls":13,"redis_duration_s":0.002789,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000874,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015273,"completed_at":"2026-07-06T10:42:05.701Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1937gitlab # [ 220.818799] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"747ce561dd1643a27941bf02","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-747ce561dd1643a27941bf02: start","job_status":"start","queue_duration_s":0.186929,"scheduling_latency_s":0.186957}1938gitlab # [ 220.820124] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"747ce561dd1643a27941bf02","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-747ce561dd1643a27941bf02: done: 0.014617 sec","job_status":"done","queue_duration_s":0.186929,"scheduling_latency_s":0.186957,"redis_calls":13,"redis_duration_s":0.00279,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014617,"completed_at":"2026-07-06T10:42:05.717Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1939gitlab # [ 220.913292] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25d140862a9b89fa49d21b94","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25d140862a9b89fa49d21b94: start","job_status":"start","queue_duration_s":0.202817,"scheduling_latency_s":0.202837}1940gitlab # [ 220.914670] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25d140862a9b89fa49d21b94","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25d140862a9b89fa49d21b94: done: 0.0147 sec","job_status":"done","queue_duration_s":0.202817,"scheduling_latency_s":0.202837,"redis_calls":13,"redis_duration_s":0.002791,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0147,"completed_at":"2026-07-06T10:42:05.733Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1941gitlab # [ 220.983795] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cee3c13acb07ef40486badd6","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cee3c13acb07ef40486badd6: start","job_status":"start","queue_duration_s":0.218833,"scheduling_latency_s":0.218854}1942gitlab # [ 220.985157] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cee3c13acb07ef40486badd6","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cee3c13acb07ef40486badd6: done: 0.014823 sec","job_status":"done","queue_duration_s":0.218833,"scheduling_latency_s":0.218854,"redis_calls":13,"redis_duration_s":0.002808,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000885,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014823,"completed_at":"2026-07-06T10:42:05.749Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1943gitlab # [ 221.052879] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d183e66a1b57375b9b9e6e5d","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d183e66a1b57375b9b9e6e5d: start","job_status":"start","queue_duration_s":0.234973,"scheduling_latency_s":0.234995}1944gitlab # [ 221.054160] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d183e66a1b57375b9b9e6e5d","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d183e66a1b57375b9b9e6e5d: done: 0.015139 sec","job_status":"done","queue_duration_s":0.234973,"scheduling_latency_s":0.234995,"redis_calls":13,"redis_duration_s":0.003015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015139,"completed_at":"2026-07-06T10:42:05.766Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1945gitlab # [ 221.129215] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73e92afc0a0e3b08d8949857","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73e92afc0a0e3b08d8949857: start","job_status":"start","queue_duration_s":0.25145,"scheduling_latency_s":0.251471}1946gitlab # [ 221.130711] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73e92afc0a0e3b08d8949857","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73e92afc0a0e3b08d8949857: done: 0.014664 sec","job_status":"done","queue_duration_s":0.25145,"scheduling_latency_s":0.251471,"redis_calls":13,"redis_duration_s":0.002755,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014664,"completed_at":"2026-07-06T10:42:05.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1947gitlab # [ 221.209473] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98b55be436e049bd25fb5484","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98b55be436e049bd25fb5484: start","job_status":"start","queue_duration_s":0.267441,"scheduling_latency_s":0.267463}1948gitlab # [ 221.210975] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98b55be436e049bd25fb5484","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98b55be436e049bd25fb5484: done: 0.014602 sec","job_status":"done","queue_duration_s":0.267441,"scheduling_latency_s":0.267463,"redis_calls":13,"redis_duration_s":0.002831,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014602,"completed_at":"2026-07-06T10:42:05.797Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1949gitlab # [ 221.296798] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b20cb8226cc44fb3f1ee7b11","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b20cb8226cc44fb3f1ee7b11: start","job_status":"start","queue_duration_s":0.283273,"scheduling_latency_s":0.283293}1950gitlab # [ 221.298152] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b20cb8226cc44fb3f1ee7b11","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b20cb8226cc44fb3f1ee7b11: done: 0.014626 sec","job_status":"done","queue_duration_s":0.283273,"scheduling_latency_s":0.283293,"redis_calls":13,"redis_duration_s":0.002772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000863,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014626,"completed_at":"2026-07-06T10:42:05.813Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1951gitlab # [ 221.381097] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b33d7bf200255c0085b0352d","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b33d7bf200255c0085b0352d: start","job_status":"start","queue_duration_s":0.299152,"scheduling_latency_s":0.299172}1952gitlab # [ 221.382084] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b33d7bf200255c0085b0352d","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b33d7bf200255c0085b0352d: done: 0.014711 sec","job_status":"done","queue_duration_s":0.299152,"scheduling_latency_s":0.299172,"redis_calls":13,"redis_duration_s":0.002724,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014711,"completed_at":"2026-07-06T10:42:05.829Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1953gitlab # [ 221.404780] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc6bed0b7580d9b350480a01","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc6bed0b7580d9b350480a01: start","job_status":"start","queue_duration_s":0.315125,"scheduling_latency_s":0.315145}1954gitlab # [ 221.470828] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc6bed0b7580d9b350480a01","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc6bed0b7580d9b350480a01: done: 0.014847 sec","job_status":"done","queue_duration_s":0.315125,"scheduling_latency_s":0.315145,"redis_calls":13,"redis_duration_s":0.002738,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014847,"completed_at":"2026-07-06T10:42:05.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1955gitlab # [ 221.483063] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcc9b92746bdba5a3eaaea2e","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcc9b92746bdba5a3eaaea2e: start","job_status":"start","queue_duration_s":0.331235,"scheduling_latency_s":0.331257}1956gitlab # [ 221.556194] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcc9b92746bdba5a3eaaea2e","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcc9b92746bdba5a3eaaea2e: done: 0.014708 sec","job_status":"done","queue_duration_s":0.331235,"scheduling_latency_s":0.331257,"redis_calls":13,"redis_duration_s":0.002688,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000844,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001844,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014708,"completed_at":"2026-07-06T10:42:05.861Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1957gitlab # [ 221.561885] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82331ffaebebaeb6d2901f88","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82331ffaebebaeb6d2901f88: start","job_status":"start","queue_duration_s":0.347415,"scheduling_latency_s":0.347439}1958gitlab # [ 221.635160] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82331ffaebebaeb6d2901f88","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82331ffaebebaeb6d2901f88: done: 0.014688 sec","job_status":"done","queue_duration_s":0.347415,"scheduling_latency_s":0.347439,"redis_calls":13,"redis_duration_s":0.002842,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0[ 221.880784] sched: DL replenish lagged too much1959gitlab # ,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014688,"completed_at":"2026-07-06T10:42:05.878Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1960gitlab # [ 221.640329] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89e917c370dc3778ad52450f","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89e917c370dc3778ad52450f: start","job_status":"start","queue_duration_s":0.363362,"scheduling_latency_s":0.363382}1961gitlab # [ 221.714380] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89e917c370dc3778ad52450f","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89e917c370dc3778ad52450f: done: 0.088254 sec","job_status":"done","queue_duration_s":0.363362,"scheduling_latency_s":0.363382,"redis_calls":13,"redis_duration_s":0.00568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001798,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.088254,"completed_at":"2026-07-06T10:42:05.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1962gitlab # [ 221.719766] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"125e9f2719b635bce28c593b","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-125e9f2719b635bce28c593b: start","job_status":"start","queue_duration_s":0.454429,"scheduling_latency_s":0.454483}1963gitlab # [ 221.791152] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:05.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"125e9f2719b635bce28c593b","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-125e9f2719b635bce28c593b: done: 0.029578 sec","job_status":"done","queue_duration_s":0.454429,"scheduling_latency_s":0.454483,"redis_calls":13,"redis_duration_s":0.004083,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001198,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029578,"completed_at":"2026-07-06T10:42:05.999Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1964gitlab # [ 221.799166] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e6cf5b2fa8379aad5df6651","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e6cf5b2fa8379aad5df6651: start","job_status":"start","queue_duration_s":0.485097,"scheduling_latency_s":0.485119}1965gitlab # [ 221.818340] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e6cf5b2fa8379aad5df6651","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e6cf5b2fa8379aad5df6651: done: 0.015086 sec","job_status":"done","queue_duration_s":0.485097,"scheduling_latency_s":0.485119,"redis_calls":13,"redis_duration_s":0.002786,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015086,"completed_at":"2026-07-06T10:42:06.016Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1966gitlab # [ 221.896984] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c1d07c87c2a0e2bff5bb932","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c1d07c87c2a0e2bff5bb932: start","job_status":"start","queue_duration_s":0.501454,"scheduling_latency_s":0.501474}1967gitlab # [ 221.898316] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c1d07c87c2a0e2bff5bb932","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c1d07c87c2a0e2bff5bb932: done: 0.01478 sec","job_status":"done","queue_duration_s":0.501454,"scheduling_latency_s":0.501474,"redis_calls":13,"redis_duration_s":0.0027790000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001868,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01478,"completed_at":"2026-07-06T10:42:06.032Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1968gitlab # [ 221.975436] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b49168a144f0c2a7d5e98dc","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b49168a144f0c2a7d5e98dc: start","job_status":"start","queue_duration_s":0.518173,"scheduling_latency_s":0.518214}1969gitlab # [ 221.976876] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b49168a144f0c2a7d5e98dc","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b49168a144f0c2a7d5e98dc: done: 0.018866 sec","job_status":"done","queue_duration_s":0.518173,"scheduling_latency_s":0.518214,"redis_calls":13,"redis_duration_s":0.0028980000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018866,"completed_at":"2026-07-06T10:42:06.052Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1970gitlab # [ 222.064352] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e59ca8fd80f39dff0f41eea3","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e59ca8fd80f39dff0f41eea3: start","job_status":"start","queue_duration_s":0.538228,"scheduling_latency_s":0.538248}1971gitlab # [ 222.065826] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e59ca8fd80f39dff0f41eea3","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e59ca8fd80f39dff0f41eea3: done: 0.015058 sec","job_status":"done","queue_duration_s":0.538228,"scheduling_latency_s":0.538248,"redis_calls":13,"redis_duration_s":0.003051,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002137,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015058,"completed_at":"2026-07-06T10:42:06.069Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1972gitlab # [ 222.139263] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9dfb64368d41fe10453eafc","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9dfb64368d41fe10453eafc: start","job_status":"start","queue_duration_s":0.554609,"scheduling_latency_s":0.55463}1973gitlab # [ 222.140725] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9dfb64368d41fe10453eafc","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9dfb64368d41fe10453eafc: done: 0.015311 sec","job_status":"done","queue_duration_s":0.554609,"scheduling_latency_s":0.55463,"redis_calls":13,"redis_duration_s":0.002705,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000861,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001844,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015311,"completed_at":"2026-07-06T10:42:06.085Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1974gitlab # [ 222.234133] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"775c951af0a8c16fe5ab2592","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-775c951af0a8c16fe5ab2592: start","job_status":"start","queue_duration_s":0.571153,"scheduling_latency_s":0.571175}1975gitlab # [ 222.235391] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"775c951af0a8c16fe5ab2592","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-775c951af0a8c16fe5ab2592: done: 0.015001 sec","job_status":"done","queue_duration_s":0.571153,"scheduling_latency_s":0.571175,"redis_calls":13,"redis_duration_s":0.002768,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00189,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015001,"completed_at":"2026-07-06T10:42:06.102Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1976gitlab # [ 222.306124] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef94d91aeb2a8acb0e5b7da8","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef94d91aeb2a8acb0e5b7da8: start","job_status":"start","queue_duration_s":0.588102,"scheduling_latency_s":0.588123}1977gitlab # [ 222.307481] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef94d91aeb2a8acb0e5b7da8","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef94d91aeb2a8acb0e5b7da8: done: 0.080697 sec","job_status":"done","queue_duration_s":0.588102,"scheduling_latency_s":0.588123,"redis_calls":13,"redis_duration_s":0.066955,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.066053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.080697,"completed_at":"2026-07-06T10:42:06.184Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1978gitlab # [ 222.375074] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6acaa380e757332b7a4efa74","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6acaa380e757332b7a4efa74: start","job_status":"start","queue_duration_s":0.670302,"scheduling_latency_s":0.670363}1979gitlab # [ 222.376107] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6acaa380e757332b7a4efa74","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6acaa380e757332b7a4efa74: done: 0.015751 sec","job_status":"done","queue_duration_s":0.670302,"scheduling_latency_s":0.670363,"redis_calls":13,"redis_duration_s":0.002745,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000838,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015751,"completed_at":"2026-07-06T10:42:06.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1980gitlab # [ 222.443995] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c1fd1e7648f315302286b64","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c1fd1e7648f315302286b64: start","job_status":"start","queue_duration_s":0.687256,"scheduling_latency_s":0.687277}1981gitlab # [ 222.510863] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c1fd1e7648f315302286b64","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c1fd1e7648f315302286b64: done: 0.015189 sec","job_status":"done","queue_duration_s":0.687256,"scheduling_latency_s":0.687277,"redis_calls":13,"redis_duration_s":0.0027559999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015189,"completed_at":"2026-07-06T10:42:06.218Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1982gitlab # [ 222.512662] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1edad225f6c589425cd85cc8","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1edad225f6c589425cd85cc8: start","job_status":"start","queue_duration_s":0.70366,"scheduling_latency_s":0.70368}1983gitlab # [ 222.581464] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1edad225f6c589425cd85cc8","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1edad225f6c589425cd85cc8: done: 0.014901 sec","job_status":"done","queue_duration_s":0.70366,"scheduling_latency_s":0.70368,"redis_calls":13,"redis_duration_s":0.002713,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000819,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014901,"completed_at":"2026-07-06T10:42:06.234Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1984gitlab # [ 222.648908] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8357a9a5245d6aaccd49cbc","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8357a9a5245d6aaccd49cbc: start","job_status":"start","queue_duration_s":0.719793,"scheduling_latency_s":0.719814}1985gitlab # [ 222.650295] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8357a9a5245d6aaccd49cbc","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8357a9a5245d6aaccd49cbc: done: 0.014826 sec","job_status":"done","queue_duration_s":0.719793,"scheduling_latency_s":0.719814,"redis_calls":13,"redis_duration_s":0.002703,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000821,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014826,"completed_at":"2026-07-06T10:42:06.250Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1986gitlab # [ 222.663790] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5c0d34ac15d74d9300465b3","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5c0d34ac15d74d9300465b3: start","job_status":"start","queue_duration_s":0.735838,"scheduling_latency_s":0.735858}1987gitlab # [ 222.682958] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5c0d34ac15d74d9300465b3","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5c0d34ac15d74d9300465b3: done: 0.019333 sec","job_status":"done","queue_duration_s":0.735838,"scheduling_latency_s":0.735858,"redis_calls":13,"redis_duration_s":0.003407,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002191,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019333,"completed_at":"2026-07-06T10:42:06.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1988gitlab # [ 222.772078] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"845e4552040865e2ba6e8bb1","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-845e4552040865e2ba6e8bb1: start","job_status":"start","queue_duration_s":0.756658,"scheduling_latency_s":0.756685}1989gitlab # [ 222.773126] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"845e4552040865e2ba6e8bb1","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-845e4552040865e2ba6e8bb1: done: 0.015499 sec","job_status":"done","queue_duration_s":0.756658,"scheduling_latency_s":0.756685,"redis_calls":13,"redis_duration_s":0.0028150000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015499,"completed_at":"2026-07-06T10:42:06.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1990gitlab # [ 222.851145] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d33bbb3513e74977691fd1a","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d33bbb3513e74977691fd1a: start","job_status":"start","queue_duration_s":0.773422,"scheduling_latency_s":0.773443}1991gitlab # [ 222.852378] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d33bbb3513e74977691fd1a","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d33bbb3513e74977691fd1a: done: 0.015309 sec","job_status":"done","queue_duration_s":0.773422,"scheduling_latency_s":0.773443,"redis_calls":13,"redis_duration_s":0.002775,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015309,"completed_at":"2026-07-06T10:42:06.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1992gitlab # [ 222.924262] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d81c6448e51a6e0eacea9f2","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d81c6448e51a6e0eacea9f2: start","job_status":"start","queue_duration_s":0.789947,"scheduling_latency_s":0.789974}1993gitlab # [ 222.925751] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d81c6448e51a6e0eacea9f2","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d81c6448e51a6e0eacea9f2: done: 0.014796 sec","job_status":"done","queue_duration_s":0.789947,"scheduling_latency_s":0.789974,"redis_calls":13,"redis_duration_s":0.0028510000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014796,"completed_at":"2026-07-06T10:42:06.320Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1994gitlab # [ 222.992813] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a23780fe1dd4c6036eaaafd","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a23780fe1dd4c6036eaaafd: start","job_status":"start","queue_duration_s":0.806004,"scheduling_latency_s":0.806024}1995gitlab # [ 222.998183] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a23780fe1dd4c6036eaaafd","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a23780fe1dd4c6036eaaafd: done: 0.015406 sec","job_status":"done","queue_duration_s":0.806004,"scheduling_latency_s":0.806024,"redis_calls":13,"redis_duration_s":0.002711,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015406,"completed_at":"2026-07-06T10:42:06.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1996gitlab # [ 223.068324] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"624dce8b439d39e9d67544b2","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-624dce8b439d39e9d67544b2: start","job_status":"start","queue_duration_s":0.822634,"scheduling_latency_s":0.822655}1997gitlab # [ 223.077451] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"624dce8b439d39e9d67544b2","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-624dce8b439d39e9d67544b2: done: 0.015021 sec","job_status":"done","queue_duration_s":0.822634,"scheduling_latency_s":0.822655,"redis_calls":13,"redis_duration_s":0.002731,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000848,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015021,"completed_at":"2026-07-06T10:42:06.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1998gitlab # [ 223.160214] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adb3f0bcb99c2a6ad8939114","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adb3f0bcb99c2a6ad8939114: start","job_status":"start","queue_duration_s":0.838909,"scheduling_latency_s":0.838929}1999gitlab # [ 223.161236] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adb3f0bcb99c2a6ad8939114","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adb3f0bcb99c2a6ad8939114: done: 0.015763 sec","job_status":"done","queue_duration_s":0.838909,"scheduling_latency_s":0.838929,"redis_calls":13,"redis_duration_s":0.0029230000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001841,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015763,"completed_at":"2026-07-06T10:42:06.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2000gitlab # [ 223.262907] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c3c2e06cb232d251b336311","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c3c2e06cb232d251b336311: start","job_status":"start","queue_duration_s":0.855878,"scheduling_latency_s":0.855899}2001gitlab # [ 223.264175] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c3c2e06cb232d251b336311","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c3c2e06cb232d251b336311: done: 0.014942 sec","job_status":"done","queue_duration_s":0.855878,"scheduling_latency_s":0.855899,"redis_calls":13,"redis_duration_s":0.002862,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014942,"completed_at":"2026-07-06T10:42:06.386Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2002gitlab # [ 223.334104] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb83b50626592e4301c5a580","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb83b50626592e4301c5a580: start","job_status":"start","queue_duration_s":0.872086,"scheduling_latency_s":0.872106}2003gitlab # [ 223.335180] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb83b50626592e4301c5a580","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb83b50626592e4301c5a580: done: 0.015337 sec","job_status":"done","queue_duration_s":0.872086,"scheduling_latency_s":0.872106,"redis_calls":13,"redis_duration_s":0.002693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00084,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001853,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015337,"completed_at":"2026-07-06T10:42:06.403Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2004gitlab # [ 223.413174] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f3efee845bbad5be118c158","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f3efee845bbad5be118c158: start","job_status":"start","queue_duration_s":0.88878,"scheduling_latency_s":0.888801}2005gitlab # [ 223.414666] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f3efee845bbad5be118c158","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f3efee845bbad5be118c158: done: 0.01767 sec","job_status":"done","queue_duration_s":0.88878,"scheduling_latency_s":0.888801,"redis_calls":13,"redis_duration_s":0.003103,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002149,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01767,"completed_at":"2026-07-06T10:42:06.422Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2006gitlab # [ 223.484282] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4e436f5e38fcb91f50062b3","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4e436f5e38fcb91f50062b3: start","job_status":"start","queue_duration_s":0.907899,"scheduling_latency_s":0.907927}2007gitlab # [ 223.485311] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4e436f5e38fcb91f50062b3","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4e436f5e38fcb91f50062b3: done: 0.015699 sec","job_status":"done","queue_duration_s":0.907899,"scheduling_latency_s":0.907927,"redis_calls":13,"redis_duration_s":0.002731,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001862,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015699,"completed_at":"2026-07-06T10:42:06.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2008gitlab # [ 223.563274] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"666c1f1f242af31f7ea12ec9","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-666c1f1f242af31f7ea12ec9: start","job_status":"start","queue_duration_s":0.925276,"scheduling_latency_s":0.925297}2009gitlab # [ 223.564733] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"666c1f1f242af31f7ea12ec9","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-666c1f1f242af31f7ea12ec9: done: 0.016615 sec","job_status":"done","queue_duration_s":0.925276,"scheduling_latency_s":0.925297,"redis_calls":13,"redis_duration_s":0.0034270000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00151,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016615,"completed_at":"2026-07-06T10:42:06.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2010gitlab # [ 223.639914] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10618892dc2907e1272cee05","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10618892dc2907e1272cee05: start","job_status":"start","queue_duration_s":0.943538,"scheduling_latency_s":0.943565}2011gitlab # [ 223.640949] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10618892dc2907e1272cee05","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10618892dc2907e1272cee05: done: 0.018175 sec","job_status":"done","queue_duration_s":0.943538,"scheduling_latency_s":0.943565,"redis_calls":13,"redis_duration_s":0.003181,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001022,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002159,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018175,"completed_at":"2026-07-06T10:42:06.477Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2012gitlab # [ 223.742840] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c299a19324377291751967b1","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c299a19324377291751967b1: start","job_status":"start","queue_duration_s":0.963044,"scheduling_latency_s":0.963067}2013gitlab # [ 223.744107] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c299a19324377291751967b1","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c299a19324377291751967b1: done: 0.015492 sec","job_status":"done","queue_duration_s":0.963044,"scheduling_latency_s":0.963067,"redis_calls":13,"redis_duration_s":0.0029370000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000812,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002125,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015492,"completed_at":"2026-07-06T10:42:06.494Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2014gitlab # [ 223.811989] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d0203795dd83b4a3b281c5a","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d0203795dd83b4a3b281c5a: start","job_status":"start","queue_duration_s":0.979769,"scheduling_latency_s":0.979791}2015gitlab # [ 223.813093] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d0203795dd83b4a3b281c5a","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d0203795dd83b4a3b281c5a: done: 0.014848 sec","job_status":"done","queue_duration_s":0.979769,"scheduling_latency_s":0.979791,"redis_calls":13,"redis_duration_s":0.002728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014848,"completed_at":"2026-07-06T10:42:06.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2016gitlab # [ 223.884312] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddac152c42aad88ceffe8b12","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddac152c42aad88ceffe8b12: start","job_status":"start","queue_duration_s":0.995835,"scheduling_latency_s":0.99635}2017gitlab # [ 223.885879] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddac152c42aad88ceffe8b12","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddac152c42aad88ceffe8b12: done: 0.015643 sec","job_status":"done","queue_duration_s":0.995835,"scheduling_latency_s":0.99635,"redis_calls":13,"redis_duration_s":0.002685,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001849,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015643,"completed_at":"2026-07-06T10:42:06.527Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2018gitlab # [ 223.959103] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0396b024ea12edb0db2b8e2","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0396b024ea12edb0db2b8e2: start","job_status":"start","queue_duration_s":1.012705,"scheduling_latency_s":1.012725}2019gitlab # [ 223.960179] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0396b024ea12edb0db2b8e2","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0396b024ea12edb0db2b8e2: done: 0.014981 sec","job_status":"done","queue_duration_s":1.012705,"scheduling_latency_s":1.012725,"redis_calls":13,"redis_duration_s":0.002771,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014981,"completed_at":"2026-07-06T10:42:06.543Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2020gitlab # [ 224.044379] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b2ce23d61d837071528d099","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b2ce23d61d837071528d099: start","job_status":"start","queue_duration_s":1.028901,"scheduling_latency_s":1.028922}2021gitlab # [ 224.045798] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b2ce23d61d837071528d099","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b2ce23d61d837071528d099: done: 0.014741 sec","job_status":"done","queue_duration_s":1.028901,"scheduling_latency_s":1.028922,"redis_calls":13,"redis_duration_s":0.002739,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014741,"completed_at":"2026-07-06T10:42:06.559Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2022gitlab # [ 224.114354] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8eb76e06545ed70cb4ec3cf6","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8eb76e06545ed70cb4ec3cf6: start","job_status":"start","queue_duration_s":1.045413,"scheduling_latency_s":1.045434}2023gitlab # [ 224.115351] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8eb76e06545ed70cb4ec3cf6","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8eb76e06545ed70cb4ec3cf6: done: 0.018823 sec","job_status":"done","queue_duration_s":1.045413,"scheduling_latency_s":1.045434,"redis_calls":13,"redis_duration_s":0.003377,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001302,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002075,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018823,"completed_at":"2026-07-06T10:42:06.580Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2024gitlab # [ 224.186095] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8dce828f1337e1905515262","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8dce828f1337e1905515262: start","job_status":"start","queue_duration_s":1.065735,"scheduling_latency_s":1.065762}2025gitlab # [ 224.187148] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:06.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8dce828f1337e1905515262","created_at":"2026-07-06T10:42:05.454Z","trace_propagation_headers":{"sentry-trace":"d10785d5033f49ca93012f70c3c34d7b-9d5d11863b514044","baggage":"sentry-trace_id=d10785d5033f49ca93012f70c3c34d7b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e4390c5e5428f811f318aa0b88777168","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-06T10:42:05.515Z","job_size_bytes":2,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8dce828f1337e1905515262: done: 0.015818 sec","job_status":"done","queue_duration_s":1.065735,"scheduling_latency_s":1.065762,"redis_calls":13,"redis_duration_s":0.003042,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002213,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015818,"completed_at":"2026-07-06T10:42:06.597Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2026gitlab # [ 224.353858] gitaly[1383]: time="2026-07-06T10:42:11.248Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGANSM6J16975F65MFXKTD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:41.146" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:11.247" grpc.time_ms=0.871 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2027gitlab # [ 224.374601] nix-daemon[3433]: accepted connection from pid 3547, user nixbot2028gitlab # [ 224.387694] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:42:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 65572029gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses, in 6.66 seconds)2030gitlab # [ 224.450736] gitaly[1383]: time="2026-07-06T10:42:11.345Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAW76HAKS61WA91ZJS0BB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:41.243" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:11.344" grpc.time_ms=0.997 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2031gitlab # [ 224.491667] gitaly[1383]: time="2026-07-06T10:42:11.386Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAW76HAKS61WA91ZJS0BB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-06T10:42:21.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:42:11.379" grpc.time_ms=6.901 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2032gitlab # [ 224.546782] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:11.440Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"25d9615ca10225b4d77d6cf4","created_at":"2026-07-06T10:42:11.429Z","trace_propagation_headers":{"sentry-trace":"15acf90e5eb543668e3a051a50e5a7e7-b2a4e4c316364c2b","baggage":"sentry-trace_id=15acf90e5eb543668e3a051a50e5a7e7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGAW76HAKS61WA91ZJS0BB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:11.431Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-25d9615ca10225b4d77d6cf4: start","job_status":"start","queue_duration_s":0.007926,"scheduling_latency_s":0.007994}2033gitlab # [ 224.571462] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/07/06:10:42:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d85f2b79a773d93928eac516779bae28bee028ab HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1632034gitlab # [ 224.576210] nixbot[3118]: {"ts": "2026-07-06T10:42:11.467Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d85f2b79a773d93928eac516779bae28bee028ab \"HTTP/1.1 201 Created\""}2035gitlab # [ 224.678888] gitaly[1383]: time="2026-07-06T10:42:11.574Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGAW76HAKS61WA91ZJS0BB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:42:11.573" grpc.time_ms=0.33 pid=1383 span.kind=server system=grpc2036gitlab # [ 224.721908] gitaly[1383]: time="2026-07-06T10:42:11.617Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGAW76HAKS61WA91ZJS0BB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:42:11.616" grpc.time_ms=0.395 pid=1383 span.kind=server system=grpc2037gitlab # [ 224.759577] gitaly[1383]: time="2026-07-06T10:42:11.654Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWVGAW76HAKS61WA91ZJS0BB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-06T10:42:11.654" grpc.time_ms=0.44 pid=1383 span.kind=server system=grpc2038gitlab # [ 224.776126] nix-daemon[3433]: accepted connection from pid 3580, user nixbot2039gitlab # [ 224.784296] gitaly[1383]: time="2026-07-06T10:42:11.679Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAW76HAKS61WA91ZJS0BB diskcache=bb3c2e42-a14b-44d6-9f0b-278321ac2e2b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-06T10:42:41.044" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:42:11.544" pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2040gitlab # [ 224.799433] gitaly[1383]: time="2026-07-06T10:42:11.694Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=115 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7050 command.oublock=0 command.real_time_ms=125 command.spawn_token_fork_ms=0 command.system_time_ms=78 command.user_time_ms=37 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAW76HAKS61WA91ZJS0BB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-06T10:42:41.044" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-06T10:42:11.544" grpc.time_ms=134.993 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2041gitlab # [ 224.864854] gitaly[1383]: time="2026-07-06T10:42:11.759Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAW76HAKS61WA91ZJS0BB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-06T10:42:41.258" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:11.759" grpc.time_ms=0.774 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2042gitlab # [ 224.890940] gitaly[1383]: time="2026-07-06T10:42:11.786Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAW76HAKS61WA91ZJS0BB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:41.284" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:11.785" grpc.time_ms=0.616 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2043gitlab # [ 224.918186] gitaly[1383]: time="2026-07-06T10:42:11.813Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWVGAWMYRY2GTJJTEN7RR0D4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-06T10:42:11.806" grpc.time_ms=7.069 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc2044gitlab # [ 224.926672] gitaly[1383]: time="2026-07-06T10:42:11.821Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWVGAW76HAKS61WA91ZJS0BB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-06T10:42:41.320" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-06T10:42:11.821" grpc.time_ms=0.57 pid=1383 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2045gitlab # [ 224.939184] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:11.833Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"25d9615ca10225b4d77d6cf4","created_at":"2026-07-06T10:42:11.429Z","trace_propagation_headers":{"sentry-trace":"15acf90e5eb543668e3a051a50e5a7e7-b2a4e4c316364c2b","baggage":"sentry-trace_id=15acf90e5eb543668e3a051a50e5a7e7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGAW76HAKS61WA91ZJS0BB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:11.431Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-25d9615ca10225b4d77d6cf4: done: 0.394221 sec","job_status":"done","queue_duration_s":0.007926,"scheduling_latency_s":0.007994,"gitaly_calls":4,"gitaly_duration_s":0.181018,"redis_calls":83,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.0199,"redis_read_bytes":173,"redis_write_bytes":20929,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001484,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002486,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_queues_calls":23,"redis_queues_duration_s":0.004448,"redis_queues_read_bytes":25,"redis_queues_write_bytes":13382,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.006287,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000278,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000838,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002595,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":36,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":21,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.141994,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.351923499,"duration_s":0.394221,"completed_at":"2026-07-06T10:42:11.833Z","load_balancing_strategy":"primary","db_duration_s":0.05607,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2046gitlab # [ 225.020513] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:11.836Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"b8d8915ab996826fea1a32f7","created_at":"2026-07-06T10:42:11.537Z","trace_propagation_headers":{"sentry-trace":"15acf90e5eb543668e3a051a50e5a7e7-7bb7f19c3841457b","baggage":"sentry-trace_id=15acf90e5eb543668e3a051a50e5a7e7,sentry-release=Unknown"},"correlation_id":"01KWVGAW76HAKS61WA91ZJS0BB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:11.539Z","job_size_bytes":23,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-b8d8915ab996826fea1a32f7: start","job_status":"start","queue_duration_s":0.297364,"scheduling_latency_s":0.297386}2047gitlab # [ 225.021875] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:11.873Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"b8d8915ab996826fea1a32f7","created_at":"2026-07-06T10:42:11.537Z","trace_propagation_headers":{"sentry-trace":"15acf90e5eb543668e3a051a50e5a7e7-7bb7f19c3841457b","baggage":"sentry-trace_id=15acf90e5eb543668e3a051a50e5a7e7,sentry-release=Unknown"},"correlation_id":"01KWVGAW76HAKS61WA91ZJS0BB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:11.539Z","job_size_bytes":23,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-b8d8915ab996826fea1a32f7: done: 0.037336 sec","job_status":"done","queue_duration_s":0.297364,"scheduling_latency_s":0.297386,"redis_calls":7,"redis_duration_s":0.001807,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001351,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000456,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037336,"completed_at":"2026-07-06T10:42:11.873Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007793,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2048gitlab # [ 225.111695] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:11.875Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4857b634e3e72c16ad780c7c","created_at":"2026-07-06T10:42:11.721Z","trace_propagation_headers":{"sentry-trace":"15acf90e5eb543668e3a051a50e5a7e7-7bb7f19c3841457b","baggage":"sentry-trace_id=15acf90e5eb543668e3a051a50e5a7e7,sentry-release=Unknown"},"correlation_id":"01KWVGAW76HAKS61WA91ZJS0BB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:11.723Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4857b634e3e72c16ad780c7c: start","job_status":"start","queue_duration_s":0.151904,"scheduling_latency_s":0.151965}2049gitlab # [ 225.112790] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:11.895Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4857b634e3e72c16ad780c7c","created_at":"2026-07-06T10:42:11.721Z","trace_propagation_headers":{"sentry-trace":"15acf90e5eb543668e3a051a50e5a7e7-7bb7f19c3841457b","baggage":"sentry-trace_id=15acf90e5eb543668e3a051a50e5a7e7,sentry-release=Unknown"},"correlation_id":"01KWVGAW76HAKS61WA91ZJS0BB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:11.723Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4857b634e3e72c16ad780c7c: done: 0.020164 sec","job_status":"done","queue_duration_s":0.151904,"scheduling_latency_s":0.151965,"redis_calls":7,"redis_duration_s":0.001641,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001217,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000424,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020164,"completed_at":"2026-07-06T10:42:11.895Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002406,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2050gitlab # [ 225.199168] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:11.896Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8b59877705e331270573f1e0","created_at":"2026-07-06T10:42:11.730Z","trace_propagation_headers":{"sentry-trace":"15acf90e5eb543668e3a051a50e5a7e7-7bb7f19c3841457b","baggage":"sentry-trace_id=15acf90e5eb543668e3a051a50e5a7e7,sentry-release=Unknown"},"correlation_id":"01KWVGAW76HAKS61WA91ZJS0BB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:11.732Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8b59877705e331270573f1e0: start","job_status":"start","queue_duration_s":0.164166,"scheduling_latency_s":0.164188}2051gitlab # [ 225.201983] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:11.967Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8b59877705e331270573f1e0","created_at":"2026-07-06T10:42:11.730Z","trace_propagation_headers":{"sentry-trace":"15acf90e5eb543668e3a051a50e5a7e7-7bb7f19c3841457b","baggage":"sentry-trace_id=15acf90e5eb543668e3a051a50e5a7e7,sentry-release=Unknown"},"correlation_id":"01KWVGAW76HAKS61WA91ZJS0BB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:11.732Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8b59877705e331270573f1e0: done: 0.070663 sec","job_status":"done","queue_duration_s":0.164166,"scheduling_latency_s":0.164188,"redis_calls":7,"redis_duration_s":0.001864,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001341,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000523,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.048,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.070663,"completed_at":"2026-07-06T10:42:11.967Z","load_balancing_strategy":"primary","db_duration_s":0.04791,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2052gitlab # [ 225.243144] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:11.969Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"41ca387026a6a9f7b4c96d6c","created_at":"2026-07-06T10:42:11.739Z","trace_propagation_headers":{"sentry-trace":"15acf90e5eb543668e3a051a50e5a7e7-7bb7f19c3841457b","baggage":"sentry-trace_id=15acf90e5eb543668e3a051a50e5a7e7,sentry-release=Unknown"},"correlation_id":"01KWVGAW76HAKS61WA91ZJS0BB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:11.742Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-41ca387026a6a9f7b4c96d6c: start","job_status":"start","queue_duration_s":0.226435,"scheduling_latency_s":0.226462}2053gitlab # [ 225.268213] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:11.995Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"41ca387026a6a9f7b4c96d6c","created_at":"2026-07-06T10:42:11.739Z","trace_propagation_headers":{"sentry-trace":"15acf90e5eb543668e3a051a50e5a7e7-7bb7f19c3841457b","baggage":"sentry-trace_id=15acf90e5eb543668e3a051a50e5a7e7,sentry-release=Unknown"},"correlation_id":"01KWVGAW76HAKS61WA91ZJS0BB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:11.742Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-41ca387026a6a9f7b4c96d6c: done: 0.026178 sec","job_status":"done","queue_duration_s":0.226435,"scheduling_latency_s":0.226462,"redis_calls":10,"redis_duration_s":0.0023150000000000002,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001173,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000686,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000456,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026178,"completed_at":"2026-07-06T10:42:11.995Z","load_balancing_strategy":"primary","db_duration_s":0.003558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2054gitlab # [ 225.347843] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:12.000Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"485439901976908199d291c6","created_at":"2026-07-06T10:42:11.743Z","trace_propagation_headers":{"sentry-trace":"15acf90e5eb543668e3a051a50e5a7e7-7bb7f19c3841457b","baggage":"sentry-trace_id=15acf90e5eb543668e3a051a50e5a7e7,sentry-release=Unknown"},"correlation_id":"01KWVGAW76HAKS61WA91ZJS0BB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:11.744Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-485439901976908199d291c6: start","job_status":"start","queue_duration_s":0.255879,"scheduling_latency_s":0.255902}2055gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses2056gitlab # [ 225.358968] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:12.183Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"485439901976908199d291c6","created_at":"2026-07-06T10:42:11.743Z","trace_propagation_headers":{"sentry-trace":"15acf90e5eb543668e3a051a50e5a7e7-7bb7f19c3841457b","baggage":"sentry-trace_id=15acf90e5eb543668e3a051a50e5a7e7,sentry-release=Unknown"},"correlation_id":"01KWVGAW76HAKS61WA91ZJS0BB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:11.744Z","job_size_bytes":3,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-485439901976908199d291c6: done: 0.183093 sec","job_status":"done","queue_duration_s":0.255879,"scheduling_latency_s":0.255902,"redis_calls":7,"redis_duration_s":0.00906,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002374,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006686,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.183093,"completed_at":"2026-07-06T10:42:12.183Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013401,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2057gitlab # [ 225.449972] sidekiq-cluster[2114]: {"severity":"INFO","time":"2026-07-06T10:42:12.185Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"1072709cf92cf480ef24a893","created_at":"2026-07-06T10:41:47.320Z","trace_propagation_headers":{"sentry-trace":"c2b123019df04b7eba125acf981f6073-7585d0020cf24122","baggage":"sentry-trace_id=c2b123019df04b7eba125acf981f6073,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA4CDMSKWJZ2JKMH1H4CQ","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:412312dbde457fe1766fb7e4fda7aafee662ad4450caa1fb12493df6efb33158","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:12.146Z","retry_count":0,"job_size_bytes":451,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-1072709cf92cf480ef24a893: start","job_status":"start","queue_duration_s":0.038702,"scheduling_latency_s":0.038726}2058gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d85f2b79a773d93928eac516779bae28bee028ab/statuses, in 0.35 seconds)2059(finished: subtest: eval and build post commit statuses, in 17.65 seconds)2060(finished: run the VM test script, in 260.63 seconds)2061test script finished in 260.69s2062cleanup2063kill QemuMachine (pid 13)2064gitlab # [ 225.451517] sidekiq-cluster[2114]: {"severity":"WARN","time":"2026-07-06T10:42:12.213Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"1072709cf92cf480ef24a893","created_at":"2026-07-06T10:41:47.320Z","trace_propagation_headers":{"sentry-trace":"c2b123019df04b7eba125acf981f6073-7585d0020cf24122","baggage":"sentry-trace_id=c2b123019df04b7eba125acf981f6073,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWVGA4CDMSKWJZ2JKMH1H4CQ","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:412312dbde457fe1766fb7e4fda7aafee662ad4450caa1fb12493df6efb33158","size_limiter":"validated","enqueued_at":"2026-07-06T10:42:12.146Z","retry_count":0,"job_size_bytes":451,"pid":2114,"sidekiq_tid":"m2v6","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-1072709cf92cf480ef24a893: fail: 0.028103 sec","job_status":"fail","queue_duration_s":0.038702,"scheduling_latency_s":0.038726,"redis_calls":7,"redis_duration_s":0.0016220000000000002,"redis_read_bytes":5,"redis_write_bytes":786,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001198,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000424,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028103,"completed_at":"2026-07-06T10:42:12.213Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traqemu-system-x86_64: terminating on signal 15 from pid 6 (/nix/store/60m4rxhg2fldqaak400c0lry96ijrzqn-python3-3.13.13/bin/python3.13)2065gitlab # v2066(finished: cleanup, in 1.31 seconds)2067additionally exposed symbols:2068 gitlab,2069 vlan1,2070 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2071[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-07-06T10:41:52.752Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2072[]2073[{'id': 1, 'project_id': 1, 'number': 1, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'd85f2b79a773d93928eac516779bae28bee028ab', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-07-06T10:41:54.754979Z', 'started_at': None, 'finished_at': None}]2074[]2075[{'id': 1, 'sha': 'd85f2b79a773d93928eac516779bae28bee028ab', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-07-06T10:41:55.452Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2076[{'id': 1, 'sha': 'd85f2b79a773d93928eac516779bae28bee028ab', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-07-06T10:41:55.452Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2077[{'id': 1, 'sha': 'd85f2b79a773d93928eac516779bae28bee028ab', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-07-06T10:41:55.452Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2078[{'id': 1, 'sha': 'd85f2b79a773d93928eac516779bae28bee028ab', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-07-06T10:41:55.452Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2079[{'id': 1, 'sha': 'd85f2b79a773d93928eac516779bae28bee028ab', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-06T10:41:55.452Z', 'started_at': None, 'finished_at': '2026-07-06T10:42:01.102Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2080[{'id': 1, 'sha': 'd85f2b79a773d93928eac516779bae28bee028ab', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-06T10:41:55.452Z', 'started_at': None, 'finished_at': '2026-07-06T10:42:01.102Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': 'd85f2b79a773d93928eac516779bae28bee028ab', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'building attributes', 'created_at': '2026-07-06T10:42:01.277Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2081[{'id': 1, 'sha': 'd85f2b79a773d93928eac516779bae28bee028ab', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-06T10:41:55.452Z', 'started_at': None, 'finished_at': '2026-07-06T10:42:01.102Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': 'd85f2b79a773d93928eac516779bae28bee028ab', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'building attributes', 'created_at': '2026-07-06T10:42:01.277Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2082[{'id': 1, 'sha': 'd85f2b79a773d93928eac516779bae28bee028ab', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-06T10:41:55.452Z', 'started_at': None, 'finished_at': '2026-07-06T10:42:01.102Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': 'd85f2b79a773d93928eac516779bae28bee028ab', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'building attributes', 'created_at': '2026-07-06T10:42:01.277Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2083[{'id': 1, 'sha': 'd85f2b79a773d93928eac516779bae28bee028ab', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-06T10:41:55.452Z', 'started_at': None, 'finished_at': '2026-07-06T10:42:01.102Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': 'd85f2b79a773d93928eac516779bae28bee028ab', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': '1 attributes built', 'created_at': '2026-07-06T10:42:01.277Z', 'started_at': None, 'finished_at': '2026-07-06T10:42:11.422Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]