vm-test-run-nixbot-gitlab
default.checks.x86_64-linux.nixbot-gitlab
· build #209
· raw
1Machine state will be reset. To keep it, pass --keep-machine-state2start all VLans3(finished: start all VLans, in 0.00 seconds)4Test will time out and terminate in 3600 seconds5run the VM test script6additionally exposed symbols:7 gitlab,8 vlan1,9 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh10start all VMs11gitlab: starting vm12gitlab # Disk image does not exist, creating the virtualisation disk image...13gitlab # Formatting '/build/vm-state-gitlab/tmp.88X0OGtPyX', fmt=raw size=107374182414gitlab # mke2fs 1.47.4 (6-Mar-2025)15gitlab # Discarding device blocks: 0/262144 done16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab # Filesystem UUID: 7135057f-9305-4568-9497-d6233795032018gitlab # Superblock backups stored on blocks:19gitlab # 32768, 98304, 163840, 22937620gitlab # 21gitlab # Allocating group tables: 0/8 done22gitlab # Writing inode tables: 0/8 done23gitlab # Creating journal (8192 blocks): done24gitlab # Writing superblocks and filesystem accounting information: 0/8 done25gitlab # 26gitlab # Virtualisation disk image created.27gitlab # Creating Nix store image...28gitlab # Created Nix store image.29gitlab: QEMU running (pid 46)30(finished: start all VMs, in 113.31 seconds)31gitlab: waiting for unit setup-gitlab.service32gitlab: waiting for the VM to finish booting33gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)34gitlab # 35gitlab # 36gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0037gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...38gitlab # 39gitlab # 40gitlab # 41gitlab # 42gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0043gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...44gitlab # 45gitlab # 46gitlab # Booting from ROM...47gitlab # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202648gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/27j0nac7nl6xj9krs6j1rvbyxldsqv5d-nixos-system-gitlab-test/init regInfo=/nix/store/lwqic1c85fpx8qill5hbs9vbhvqks81v-closure-info/registration console=ttyS0,115200n8 console=tty049gitlab # [ 0.000000] x86 CPU feature dependency check failure: CPU0 has '18*32+31' enabled but '18*32+26' disabled. Kernel might be fine, but no guarantees.50gitlab # [ 0.000000] BIOS-provided physical RAM map:51gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable52gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved56gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved57gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved58gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable59gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved60gitlab # [ 0.000000] NX (Execute Disable) protection: active61gitlab # [ 0.000000] APIC: Static calls initialized62gitlab # [ 0.000000] SMBIOS 2.8 present.63gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201464gitlab # [ 0.000000] DMI: Memory slots populated: 1/165gitlab # [ 0.000000] Hypervisor detected: KVM66gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x40000000067gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0068gitlab # [ 0.000002] kvm-clock: using sched offset of 551789128 cycles69gitlab # [ 0.000007] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns70gitlab # [ 0.000016] tsc: Detected 3099.998 MHz processor71gitlab # [ 0.000967] last_pfn = 0x1c0000 max_arch_pfn = 0x40000000072gitlab # [ 0.001006] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs73gitlab # [ 0.001009] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT74gitlab # [ 0.001053] last_pfn = 0xbffd8 max_arch_pfn = 0x40000000075gitlab # [ 0.003103] found SMP MP-table at [mem 0x000f5470-0x000f547f]76gitlab # [ 0.003120] Using GB pages for direct mapping77gitlab # [ 0.003230] RAMDISK: [mem 0xbe31c000-0xbffcffff]78gitlab # [ 0.003239] ACPI: Early table checksum verification disabled79gitlab # [ 0.003243] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )80gitlab # [ 0.003246] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.003251] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.003258] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.003260] ACPI: FACS 0x00000000BFFE0000 00004084gitlab # [ 0.003262] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)85gitlab # [ 0.003264] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)86gitlab # [ 0.003266] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)87gitlab # [ 0.003268] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]88gitlab # [ 0.003269] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]89gitlab # [ 0.003270] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]90gitlab # [ 0.003271] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]91gitlab # [ 0.003271] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]92gitlab # [ 0.003272] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]93gitlab # [ 0.003691] No NUMA configuration found94gitlab # [ 0.003693] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]95gitlab # [ 0.003695] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]96gitlab # [ 0.003796] Zone ranges:97gitlab # [ 0.003797] DMA [mem 0x0000000000001000-0x0000000000ffffff]98gitlab # [ 0.003799] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]99gitlab # [ 0.003800] Normal [mem 0x0000000100000000-0x00000001bfffffff]100gitlab # [ 0.003801] Device empty101gitlab # [ 0.003802] Movable zone start for each node102gitlab # [ 0.003802] Early memory node ranges103gitlab # [ 0.003802] node 0: [mem 0x0000000000001000-0x000000000009efff]104gitlab # [ 0.003803] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]105gitlab # [ 0.003804] node 0: [mem 0x0000000100000000-0x00000001bfffffff]106gitlab # [ 0.003806] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]107gitlab # [ 0.003826] On node 0, zone DMA: 1 pages in unavailable ranges108gitlab # [ 0.004093] On node 0, zone DMA: 97 pages in unavailable ranges109gitlab # [ 0.110616] On node 0, zone Normal: 40 pages in unavailable ranges110gitlab # [ 0.111382] ACPI: PM-Timer IO Port: 0x608111gitlab # [ 0.111396] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])112gitlab # [ 0.111429] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23113gitlab # [ 0.111431] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)114gitlab # [ 0.111432] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)115gitlab # [ 0.111433] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)116gitlab # [ 0.111434] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)117gitlab # [ 0.111435] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)118gitlab # [ 0.111437] ACPI: Using ACPI (MADT) for SMP configuration information119gitlab # [ 0.111438] ACPI: HPET id: 0x8086a201 base: 0xfed00000120gitlab # [ 0.111445] TSC deadline timer available121gitlab # [ 0.111450] CPU topo: Max. logical packages: 1122gitlab # [ 0.111451] CPU topo: Max. logical dies: 1123gitlab # [ 0.111451] CPU topo: Max. dies per package: 1124gitlab # [ 0.111455] CPU topo: Max. threads per core: 1125gitlab # [ 0.111455] CPU topo: Num. cores per package: 4126gitlab # [ 0.111456] CPU topo: Num. threads per package: 4127gitlab # [ 0.111456] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs128gitlab # [ 0.111480] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()129gitlab # [ 0.111498] kvm-guest: KVM setup pv remote TLB flush130gitlab # [ 0.111500] kvm-guest: setup PV sched yield131gitlab # [ 0.111521] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]132gitlab # [ 0.111523] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]133gitlab # [ 0.111524] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]134gitlab # [ 0.111525] [mem 0xc0000000-0xfeffbfff] available for PCI devices135gitlab # [ 0.111526] Booting paravirtualized kernel on KVM136gitlab # [ 0.111530] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns137gitlab # [ 0.115970] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1138gitlab # [ 0.118432] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288139gitlab # [ 0.118492] kvm-guest: PV spinlocks enabled140gitlab # [ 0.118494] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)141gitlab # [ 0.118497] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/27j0nac7nl6xj9krs6j1rvbyxldsqv5d-nixos-system-gitlab-test/init regInfo=/nix/store/lwqic1c85fpx8qill5hbs9vbhvqks81v-closure-info/registration console=ttyS0,115200n8 console=tty0142gitlab # [ 0.118596] Unknown kernel command line parameters "regInfo=/nix/store/lwqic1c85fpx8qill5hbs9vbhvqks81v-closure-info/registration", will be passed to user space.143gitlab # [ 0.118615] random: crng init done144gitlab # [ 0.118616] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes145gitlab # [ 0.128737] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)146gitlab # [ 0.133156] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)147gitlab # [ 0.133243] software IO TLB: area num 4.148gitlab # [ 0.212571] Fallback order for Node 0: 0149gitlab # [ 0.212587] Built 1 zonelists, mobility grouping on. Total pages: 1572726150gitlab # [ 0.212590] Policy zone: Normal151gitlab # [ 0.216114] mem auto-init: stack:all(zero), heap alloc:on, heap free:off152gitlab # [ 0.230976] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1153gitlab # [ 0.243692] allocated 12582912 bytes of page_ext154gitlab # [ 0.252137] ftrace: allocating 48717 entries in 192 pages155gitlab # [ 0.252142] ftrace: allocated 192 pages with 2 groups156gitlab # [ 0.253071] Dynamic Preempt: lazy157gitlab # [ 0.253234] rcu: Preemptible hierarchical RCU implementation.158gitlab # [ 0.253235] rcu: RCU event tracing is enabled.159gitlab # [ 0.253235] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.160gitlab # [ 0.253237] Trampoline variant of Tasks RCU enabled.161gitlab # [ 0.253237] Rude variant of Tasks RCU enabled.162gitlab # [ 0.253237] Tracing variant of Tasks RCU enabled.163gitlab # [ 0.253238] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.164gitlab # [ 0.253239] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4165gitlab # [ 0.253265] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.166gitlab # [ 0.253267] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.167gitlab # [ 0.253269] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.168gitlab # [ 0.259407] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16169gitlab # [ 0.259737] rcu: srcu_init: Setting srcu_struct sizes based on contention.170gitlab # [ 0.259745] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns171gitlab # [ 0.259857] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)172gitlab # [ 0.266437] Console: colour VGA+ 80x25173gitlab # [ 0.266447] printk: legacy console [tty0] enabled174gitlab # [ 0.308892] printk: legacy console [ttyS0] enabled175gitlab # [ 0.480042] ACPI: Core revision 20250807176gitlab # [ 0.481877] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns177gitlab # [ 0.485447] APIC: Switch to symmetric I/O mode setup178gitlab # [ 0.487801] x2apic enabled179gitlab # [ 0.489086] APIC: Switched APIC routing to: physical x2apic180gitlab # [ 0.491814] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()181gitlab # [ 0.494588] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()182gitlab # [ 0.498107] kvm-guest: setup PV IPIs183gitlab # [ 0.502147] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1184gitlab # [ 0.504298] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x2caf45e6a57, max_idle_ns: 440795365367 ns185gitlab # [ 0.508838] Calibrating delay loop (skipped) preset value.. 6199.99 BogoMIPS (lpj=3099998)186gitlab # [ 0.511845] x86/cpu: User Mode Instruction Prevention (UMIP) activated187gitlab # [ 0.514091] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127188gitlab # [ 0.514835] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0189gitlab # [ 0.516855] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto190gitlab # [ 0.518844] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl191gitlab # [ 0.520852] Spectre V2 : Mitigation: Retpolines192gitlab # [ 0.522830] RETBleed: Mitigation: untrained return thunk193gitlab # [ 0.524833] Speculative Return Stack Overflow: Mitigation: SMT disabled194gitlab # [ 0.526853] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization195gitlab # [ 0.528829] Spectre V2 : Spectre v2 / SpectreRSB: Filling RSB on context switch and VMEXIT196gitlab # [ 0.529830] Spectre V2 : Enabling Speculation Barrier for firmware calls197gitlab # [ 0.531837] active return thunk: retbleed_return_thunk198gitlab # [ 0.533838] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier199gitlab # [ 0.534863] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'200gitlab # [ 0.536832] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'201gitlab # [ 0.537840] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'202gitlab # [ 0.538843] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256203gitlab # [ 0.540830] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'compacted' format.204gitlab # [ 0.569887] Freeing SMP alternatives memory: 44K205gitlab # [ 0.570830] pid_max: default: 32768 minimum: 301206gitlab # [ 0.571940] LSM: initializing lsm=capability,landlock,yama,bpf,ima207gitlab # [ 0.572931] landlock: Up and running.208gitlab # [ 0.573829] Yama: becoming mindful.209gitlab # [ 0.575044] LSM support for eBPF active210gitlab # [ 0.576130] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)211gitlab # [ 0.577030] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)212gitlab # [ 0.580810] smpboot: CPU0: AMD Ryzen 9 3900 12-Core Processor (family: 0x17, model: 0x71, stepping: 0x0)213gitlab # [ 0.581517] Performance Events: Fam17h+ core perfctr, AMD PMU driver.214gitlab # [ 0.582833] ... version: 0215gitlab # [ 0.583859] ... bit width: 48216gitlab # [ 0.584828] ... generic counters: 6217gitlab # [ 0.585820] ... generic bitmap: 000000000000003f218gitlab # [ 0.586828] ... fixed-purpose counters: 0219gitlab # [ 0.587828] ... fixed-purpose bitmap: 0000000000000000220gitlab # [ 0.588828] ... value mask: 0000ffffffffffff221gitlab # [ 0.589828] ... max period: 00007fffffffffff222gitlab # [ 0.590828] ... global_ctrl mask: 000000000000003f223gitlab # [ 0.591939] signal: max sigframe size: 1776224gitlab # [ 0.592959] rcu: Hierarchical SRCU implementation.225gitlab # [ 0.593833] rcu: Max phase no-delay instances is 400.226gitlab # [ 0.594990] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level227gitlab # [ 0.599270] smp: Bringing up secondary CPUs ...228gitlab # [ 0.600209] smpboot: x86: Booting SMP configuration:229gitlab # [ 0.600830] .... node #0, CPUs: #1 #2 #3230gitlab # [ 0.602890] smp: Brought up 1 node, 4 CPUs231gitlab # [ 0.604798] smpboot: Total of 4 processors activated (24799.98 BogoMIPS)232gitlab # [ 0.606144] Memory: 6013604K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 258080K reserved, 0K cma-reserved)233gitlab # [ 0.607318] devtmpfs: initialized234gitlab # [ 0.608721] x86/mm: Memory block size: 128MB235gitlab # [ 0.611943] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)236gitlab # [ 0.613906] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).237gitlab # [ 0.614992] pinctrl core: initialized pinctrl subsystem238gitlab # [ 0.616149] PM: RTC time: 13:12:46, date: 2026-08-13239gitlab # [ 0.619651] NET: Registered PF_NETLINK/PF_ROUTE protocol family240gitlab # [ 0.622022] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations241gitlab # [ 0.622940] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations242gitlab # [ 0.624891] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations243gitlab # [ 0.625848] audit: initializing netlink subsys (disabled)244gitlab # [ 0.626941] audit: type=2000 audit(1786626766.102:1): state=initialized audit_enabled=0 res=1245gitlab # [ 0.627129] thermal_sys: Registered thermal governor 'fair_share'246gitlab # [ 0.627831] thermal_sys: Registered thermal governor 'bang_bang'247gitlab # [ 0.628830] thermal_sys: Registered thermal governor 'step_wise'248gitlab # [ 0.629830] thermal_sys: Registered thermal governor 'user_space'249gitlab # [ 0.630832] thermal_sys: Registered thermal governor 'power_allocator'250gitlab # [ 0.631875] cpuidle: using governor menu251gitlab # [ 0.634949] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5252gitlab # [ 0.636195] PCI: Using configuration type 1 for base access253gitlab # [ 0.636833] PCI: Using configuration type 1 for extended access254gitlab # [ 0.640036] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.255gitlab # [ 0.641981] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages256gitlab # [ 0.642830] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page257gitlab # [ 0.643832] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages258gitlab # [ 0.644833] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page259gitlab # [ 0.647323] ACPI: Added _OSI(Module Device)260gitlab # [ 0.648831] ACPI: Added _OSI(Processor Device)261gitlab # [ 0.649830] ACPI: Added _OSI(Processor Aggregator Device)262gitlab # [ 0.652120] ACPI: 1 ACPI AML tables successfully acquired and loaded263gitlab # [ 0.657841] ACPI: Interpreter enabled264gitlab # [ 0.658844] ACPI: PM: (supports S0 S3 S4 S5)265gitlab # [ 0.659836] ACPI: Using IOAPIC for interrupt routing266gitlab # [ 0.661024] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug267gitlab # [ 0.662834] PCI: Using E820 reservations for host bridge windows268gitlab # [ 0.664149] ACPI: Enabled 2 GPEs in block 00 to 0F269gitlab # [ 0.669215] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])270gitlab # [ 0.670840] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]271gitlab # [ 0.672769] acpiphp: Slot [3] registered272gitlab # [ 0.673655] acpiphp: Slot [4] registered273gitlab # [ 0.675651] acpiphp: Slot [5] registered274gitlab # [ 0.676665] acpiphp: Slot [6] registered275gitlab # [ 0.677584] acpiphp: Slot [7] registered276gitlab # [ 0.678576] acpiphp: Slot [8] registered277gitlab # [ 0.679615] acpiphp: Slot [9] registered278gitlab # [ 0.680596] acpiphp: Slot [10] registered279gitlab # [ 0.681605] acpiphp: Slot [11] registered280gitlab # [ 0.682764] acpiphp: Slot [12] registered281gitlab # [ 0.683742] acpiphp: Slot [13] registered282gitlab # [ 0.684661] acpiphp: Slot [14] registered283gitlab # [ 0.686660] acpiphp: Slot [15] registered284gitlab # [ 0.687639] acpiphp: Slot [16] registered285gitlab # [ 0.688744] acpiphp: Slot [17] registered286gitlab # [ 0.689663] acpiphp: Slot [18] registered287gitlab # [ 0.690621] acpiphp: Slot [19] registered288gitlab # [ 0.691656] acpiphp: Slot [20] registered289gitlab # [ 0.692654] acpiphp: Slot [21] registered290gitlab # [ 0.693623] acpiphp: Slot [22] registered291gitlab # [ 0.694660] acpiphp: Slot [23] registered292gitlab # [ 0.696628] acpiphp: Slot [24] registered293gitlab # [ 0.697675] acpiphp: Slot [25] registered294gitlab # [ 0.698673] acpiphp: Slot [26] registered295gitlab # [ 0.699698] acpiphp: Slot [27] registered296gitlab # [ 0.700609] acpiphp: Slot [28] registered297gitlab # [ 0.701572] acpiphp: Slot [29] registered298gitlab # [ 0.702648] acpiphp: Slot [30] registered299gitlab # [ 0.703585] acpiphp: Slot [31] registered300gitlab # [ 0.704705] PCI host bridge to bus 0000:00301gitlab # [ 0.705646] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]302gitlab # [ 0.707830] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]303gitlab # [ 0.708830] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]304gitlab # [ 0.710830] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]305gitlab # [ 0.712831] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]306gitlab # [ 0.713840] pci_bus 0000:00: root bus resource [bus 00-ff]307gitlab # [ 0.715640] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint308gitlab # [ 0.718620] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint309gitlab # [ 0.720539] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint310gitlab # [ 0.724462] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]311gitlab # [ 0.725882] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk312gitlab # [ 0.726829] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk313gitlab # [ 0.728830] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk314gitlab # [ 0.729840] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk315gitlab # [ 0.732238] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint316gitlab # [ 0.735675] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]317gitlab # [ 0.737717] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint318gitlab # [ 0.740392] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI319gitlab # [ 0.742862] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB320gitlab # [ 0.745298] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint321gitlab # [ 0.757240] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]322gitlab # [ 0.758909] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]323gitlab # [ 0.760880] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]324gitlab # [ 0.762075] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]325gitlab # [ 0.765813] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint326gitlab # [ 0.770871] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]327gitlab # [ 0.771847] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]328gitlab # [ 0.773875] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]329gitlab # [ 0.775847] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]330gitlab # [ 0.778831] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint331gitlab # [ 0.782858] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]332gitlab # [ 0.788831] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]333gitlab # [ 0.790884] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]334gitlab # [ 0.796624] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint335gitlab # [ 0.800717] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]336gitlab # [ 0.801846] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]337gitlab # [ 0.802879] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]338gitlab # [ 0.806424] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint339gitlab # [ 0.810751] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]340gitlab # [ 0.811849] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]341gitlab # [ 0.813876] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]342gitlab # [ 0.817445] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint343gitlab # [ 0.821841] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]344gitlab # [ 0.822843] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]345gitlab # [ 0.824881] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]346gitlab # [ 0.828407] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint347gitlab # [ 0.832844] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]348gitlab # [ 0.833849] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]349gitlab # [ 0.835882] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]350gitlab # [ 0.839475] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint351gitlab # [ 0.842522] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]352gitlab # [ 0.843845] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]353gitlab # [ 0.845892] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]354gitlab # [ 0.847844] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]355gitlab # [ 0.850407] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint356gitlab # [ 0.855857] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]357gitlab # [ 0.856875] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]358gitlab # [ 0.862451] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint359gitlab # [ 0.866865] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]360gitlab # [ 0.868844] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]361gitlab # [ 0.869875] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]362gitlab # [ 0.873426] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint363gitlab # [ 0.881849] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]364gitlab # [ 0.882848] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]365gitlab # [ 0.884900] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]366gitlab # [ 0.893195] ACPI: PCI: Interrupt link LNKA configured for IRQ 10367gitlab # [ 0.895009] ACPI: PCI: Interrupt link LNKB configured for IRQ 10368gitlab # [ 0.896983] ACPI: PCI: Interrupt link LNKC configured for IRQ 11369gitlab # [ 0.898006] ACPI: PCI: Interrupt link LNKD configured for IRQ 11370gitlab # [ 0.899910] ACPI: PCI: Interrupt link LNKS configured for IRQ 9371gitlab # [ 0.903189] iommu: Default domain type: Translated372gitlab # [ 0.903814] iommu: DMA domain TLB invalidation policy: lazy mode373gitlab # [ 0.906171] ACPI: bus type USB registered374gitlab # [ 0.907904] usbcore: registered new interface driver usbfs375gitlab # [ 0.908847] usbcore: registered new interface driver hub376gitlab # [ 0.910843] usbcore: registered new device driver usb377gitlab # [ 0.913059] NetLabel: Initializing378gitlab # [ 0.913829] NetLabel: domain hash size = 128379gitlab # [ 0.916842] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO380gitlab # [ 0.919136] NetLabel: unlabeled traffic allowed by default381gitlab # [ 0.919848] PCI: Using ACPI for IRQ routing382gitlab # [ 0.921992] pci 0000:00:02.0: vgaarb: setting as boot VGA device383gitlab # [ 0.922825] pci 0000:00:02.0: vgaarb: bridge control possible384gitlab # [ 0.922825] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none385gitlab # [ 0.926832] vgaarb: loaded386gitlab # [ 0.927842] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0387gitlab # [ 0.928829] hpet0: 3 comparators, 64-bit 100.000000 MHz counter388gitlab # [ 0.936124] clocksource: Switched to clocksource kvm-clock389gitlab # [ 0.939532] VFS: Disk quotas dquot_6.6.0390gitlab # [ 0.940555] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)391gitlab # [ 0.942447] pnp: PnP ACPI init392gitlab # [ 0.943964] pnp: PnP ACPI: found 6 devices393gitlab # [ 0.952598] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns394gitlab # [ 0.956161] clocksource: Switched to clocksource acpi_pm395gitlab # [ 0.960046] NET: Registered PF_INET protocol family396gitlab # [ 0.962858] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)397gitlab # [ 0.982277] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)398gitlab # [ 0.984531] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)399gitlab # [ 0.986585] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)400gitlab # [ 0.991131] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)401gitlab # [ 0.993032] TCP: Hash tables configured (established 65536 bind 65536)402gitlab # [ 0.994859] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)403gitlab # [ 0.996691] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)404gitlab # [ 0.998873] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)405gitlab # [ 1.001422] NET: Registered PF_UNIX/PF_LOCAL protocol family406gitlab # [ 1.003242] NET: Registered PF_XDP protocol family407gitlab # [ 1.004544] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]408gitlab # [ 1.006073] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]409gitlab # [ 1.007616] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]410gitlab # [ 1.009285] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]411gitlab # [ 1.011231] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]412gitlab # [ 1.013430] pci 0000:00:01.0: PIIX3: Enabling Passive Release413gitlab # [ 1.015155] pci 0000:00:00.0: Limiting direct PCI/PCI transfers414gitlab # [ 1.018349] ACPI: \_SB_.LNKD: Enabled at IRQ 11415gitlab # [ 1.021391] PCI: CLS 0 bytes, default 64416gitlab # [ 1.022513] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)417gitlab # [ 1.022685] Trying to unpack rootfs image as initramfs...418gitlab # [ 1.022816] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)419gitlab # [ 1.027359] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2caf45e6a57, max_idle_ns: 440795365367 ns420gitlab # [ 1.046031] Initialise system trusted keyrings421gitlab # [ 1.047621] workingset: timestamp_bits=40 max_order=21 bucket_order=0422gitlab # [ 1.059237] Key type asymmetric registered423gitlab # [ 1.060286] Asymmetric key parser 'x509' registered424gitlab # [ 1.061532] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)425gitlab # [ 1.063626] io scheduler mq-deadline registered426gitlab # [ 1.064830] io scheduler kyber registered427gitlab # [ 1.068421] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled428gitlab # [ 1.070575] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A429gitlab # [ 1.074225] Linux agpgart interface v0.103430gitlab # [ 1.075561] ACPI: bus type drm_connector registered431gitlab # [ 1.078634] usbcore: registered new interface driver usbserial_generic432gitlab # [ 1.080193] usbserial: USB Serial support registered for generic433gitlab # [ 1.081619] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled434gitlab # [ 1.083539] drop_monitor: Initializing network drop monitor service435gitlab # [ 1.085180] NET: Registered PF_INET6 protocol family436gitlab # [ 1.089465] Segment Routing with IPv6437gitlab # [ 1.091573] In-situ OAM (IOAM) with IPv6438gitlab # [ 1.094404] IPI shorthand broadcast: enabled439gitlab # [ 1.097899] sched_clock: Marking stable (859028949, 238080420)->(1181386471, -84277102)440gitlab # [ 1.100411] registered taskstats version 1441gitlab # [ 1.102024] Loading compiled-in X.509 certificates442gitlab # [ 1.109198] Demotion targets for Node 0: null443gitlab # [ 1.110719] Key type .fscrypt registered444gitlab # [ 1.111715] Key type fscrypt-provisioning registered445gitlab # [ 1.113074] ima: No TPM chip found, activating TPM-bypass!446gitlab # [ 1.114402] ima: Allocated hash algorithm: sha1447gitlab # [ 1.115553] ima: No architecture policies found448gitlab # [ 1.116933] PM: Magic number: 6:535:230449gitlab # [ 1.118837] RAS: Correctable Errors collector initialized.450gitlab # [ 1.123641] clk: Disabling unused clocks451gitlab # [ 1.124647] PM: genpd: Disabling unused power domains452gitlab # [ 1.343548] Freeing initrd memory: 29392K453gitlab # [ 1.348119] Freeing unused decrypted memory: 2028K454gitlab # [ 1.351286] Freeing unused kernel image (initmem) memory: 3640K455gitlab # [ 1.352874] Write protecting the kernel read-only data: 32768k456gitlab # [ 1.355278] Freeing unused kernel image (text/rodata gap) memory: 1220K457gitlab # [ 1.357379] Freeing unused kernel image (rodata/data gap) memory: 760K458gitlab # [ 1.393557] x86/mm: Checked W+X mappings: passed, no W+X pages found.459gitlab # [ 1.395158] Run /init as init process460gitlab # [ 1.406849] systemd[1]: Inserted module 'autofs4'461gitlab # [ 1.428465] fuse: init (API version 7.45)462gitlab # [ 1.435891] ACPI: \_SB_.LNKC: Enabled at IRQ 10463gitlab # [ 1.444462] ACPI: \_SB_.LNKA: Enabled at IRQ 10464gitlab # [ 1.448473] ACPI: \_SB_.LNKB: Enabled at IRQ 11465gitlab # [ 1.487464] systemd[1]: Successfully made /usr/ read-only.466gitlab # [ 1.823957] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)467gitlab # [ 1.832030] systemd[1]: Detected virtualization kvm.468gitlab # [ 1.833594] systemd[1]: Detected architecture x86-64.469gitlab # [ 1.835144] systemd[1]: Running in initrd.470gitlab # [ 1.836769] systemd[1]: Initializing machine ID from random generator.471gitlab # [ 1.838844] systemd[1]: Hostname set to <gitlab>.472gitlab # [ 1.922227] systemd[1]: bpf-restrict-fs: LSM BPF program attached473gitlab # [ 1.955018] systemd[1]: Queued start job for default target Initrd Default Target.474gitlab # [ 1.968567] systemd[1]: Created slice Slice /system/modprobe.475gitlab # [ 1.970260] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.476gitlab # [ 1.972641] systemd[1]: Expecting device /dev/disk/by-label/nix-store...477gitlab # [ 1.974630] systemd[1]: Expecting device /dev/disk/by-label/nixos...478gitlab # [ 1.976772] systemd[1]: Reached target Path Units.479gitlab # [ 1.978554] systemd[1]: Reached target Slice Units.480gitlab # [ 1.980351] systemd[1]: Reached target Swaps.481gitlab # [ 1.981910] systemd[1]: Reached target Timer Units.482gitlab # [ 1.983789] systemd[1]: Listening on D-Bus System Message Bus Socket.483gitlab # [ 1.985957] systemd[1]: Listening on Journal Socket (/dev/log).484gitlab # [ 1.988021] systemd[1]: Listening on Journal Sockets.485gitlab # [ 1.989866] systemd[1]: Listening on udev Control Socket.486gitlab # [ 1.991669] systemd[1]: Listening on udev Kernel Socket.487gitlab # [ 1.993406] systemd[1]: Reached target Socket Units.488gitlab # [ 1.996255] systemd[1]: Starting Create List of Static Device Nodes...489gitlab # [ 1.999341] systemd[1]: Starting Load Kernel Module 9pnet_virtio...490gitlab # [ 2.002451] systemd[1]: Starting Load Kernel Module configfs...491gitlab # [ 2.007264] systemd[1]: Starting Journal Service...492gitlab # [ 2.009683] systemd[1]: Starting Load Kernel Modules...493gitlab # [ 2.011138] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os494gitlab # [ 2.016219] systemd[1]: Starting Coldplug All udev Devices...495gitlab # [ 2.028021] systemd[1]: Finished Create List of Static Device Nodes.496gitlab # [ 2.030364] systemd-journald[92]: Collecting audit messages is disabled.497gitlab # [ 2.030604] systemd[1]: modprobe@configfs.service: Deactivated successfully.498gitlab # [ 2.034273] systemd[1]: Finished Load Kernel Module configfs.499gitlab # [ 2.036489] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config500gitlab # [ 2.042222] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...501gitlab # [ 2.043145] netfs: FS-Cache loaded502gitlab # [ 2.044754] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.503gitlab # [ 2.048021] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev504gitlab # [ 2.055155] 9pnet: Installing 9P2000 support505gitlab # [ 2.060365] systemd[1]: Finished Load Kernel Modules.506gitlab # [ 2.062461] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.507gitlab # [ 2.065232] systemd[1]: Finished Load Kernel Module 9pnet_virtio.508gitlab # [ 2.068526] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.509gitlab # [ 2.072487] systemd[1]: Starting Apply Kernel Variables...510gitlab # [ 2.075259] systemd[1]: Starting Create Static Device Nodes in /dev...511gitlab # [ 2.086708] systemd[1]: Finished Apply Kernel Variables.512gitlab # [ 2.089188] systemd[1]: Finished Create Static Device Nodes in /dev.513gitlab # [ 2.091170] systemd[1]: Reached target Preparation for Local File Systems.514gitlab # [ 2.093005] systemd[1]: Reached target Local File Systems.515gitlab # [ 1.855041] systemd-modules-load[93]: Using 4 probe threads516gitlab # [ 1.857909] systemd-modules-load[93]: Inserted module 'virtio_balloon'517gitlab # [ 1.859402] systemd-modules-load[93]: Inserted module 'dm_mod'518gitlab # [ 1.860737] systemd-modules-load[93]: Inserted module 'virtio_gpu'519gitlab # [ 2.099199] systemd[1]: Starting Rule-based Manager for Device Events and Files...520gitlab # [ 2.101335] systemd[1]: Started Journal Service.521gitlab # [ 1.873584] systemd[1]: Starting Create System Files and Directories...522gitlab # [ 1.876095] systemd[1]: Finished Coldplug All udev Devices.523gitlab # [ 1.880759] systemd[1]: Finished Create System Files and Directories.524gitlab # [ 1.886363] systemd-udevd[105]: Using default interface naming scheme 'v261'.525gitlab # [ 1.899486] systemd[1]: Started Rule-based Manager for Device Events and Files.526gitlab # [ 1.901097] systemd[1]: Reached target System Initialization.527gitlab # [ 1.902289] systemd[1]: Reached target Basic System.528gitlab # [ 2.256137] virtio_blk virtio4: 4/0/0 default/read/poll queues529gitlab # [ 2.266586] uhci_hcd 0000:00:01.2: UHCI Host Controller530gitlab # [ 2.270130] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1531gitlab # [ 2.271612] uhci_hcd 0000:00:01.2: detected 2 ports532gitlab # [ 2.272887] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140533gitlab # [ 2.274731] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18534gitlab # [ 2.277046] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1535gitlab # [ 2.278666] usb usb1: Product: UHCI Host Controller536gitlab # [ 2.279815] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd537gitlab # [ 2.280980] usb usb1: SerialNumber: 0000:00:01.2538gitlab # [ 2.283896] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)539gitlab # [ 2.286148] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12540gitlab # [ 2.286263] SCSI subsystem initialized541gitlab # [ 2.288140] serio: i8042 KBD port at 0x60,0x64 irq 1542gitlab # [ 2.290249] serio: i8042 AUX port at 0x60,0x64 irq 12543gitlab # [ 2.293159] hub 1-0:1.0: USB hub found544gitlab # [ 2.293959] hub 1-0:1.0: 2 ports detected545gitlab # [ 2.296391] virtio_blk virtio5: 4/0/0 default/read/poll queues546gitlab # [ 2.300107] virtio_blk virtio5: [vdb] 11666904 512-byte logical blocks (5.97 GB/5.56 GiB)547gitlab # [ 2.327652] scsi host0: ata_piix548gitlab # [ 2.329226] scsi host1: ata_piix549gitlab # [ 2.330054] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0550gitlab # [ 2.331515] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0551gitlab # [ 2.120403] systemd[1]: Starting Virtual Console Setup...552gitlab # [ 2.129944] systemd[1]: Found device /dev/disk/by-label/nixos.553gitlab # [ 2.131532] systemd[1]: Reached target Initrd Root Device.554gitlab # [ 2.133131] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...555gitlab # [ 2.134910] systemd[1]: Found device /dev/disk/by-label/nix-store.556gitlab # [ 2.146808] systemd-vconsole-setup[150]: Configuration of first virtual console was skipped, ignoring remaining ones.557gitlab # [ 2.150396] systemd[1]: Finished Virtual Console Setup.558gitlab # [ 2.152460] systemd-fsck[154]: nixos: clean, 12/65536 files, 13019/262144 blocks559gitlab # [ 2.155945] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.560gitlab # [ 2.489314] ata2: found unknown device (class 0)561gitlab # [ 2.491133] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100562gitlab # [ 2.493669] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5563gitlab # [ 2.281301] (udev-worker)[122]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.564gitlab # [ 2.518993] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0565gitlab # [ 2.284822] (udev-worker)[122]: Network interface NamePolicy= disabled on kernel command line.566gitlab # [ 2.287187] (udev-worker)[131]: Network interface NamePolicy= disabled on kernel command line.567gitlab # [ 2.537124] usb 1-1: new full-speed USB device number 2 using uhci_hcd568gitlab # [ 2.551129] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray569gitlab # [ 2.582637] cdrom: Uniform CD-ROM driver Revision: 3.20570gitlab # [ 2.706597] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00571gitlab # [ 2.708414] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10572gitlab # [ 2.709983] usb 1-1: Product: QEMU USB Tablet573gitlab # [ 2.710909] usb 1-1: Manufacturer: QEMU574gitlab # [ 2.712024] usb 1-1: SerialNumber: 28754-0000:00:01.2-1575gitlab # [ 2.727611] hid: raw HID events driver (C) Jiri Kosina576gitlab # [ 2.736795] usbcore: registered new interface driver usbhid577gitlab # [ 2.737960] usbhid: USB HID core driver578gitlab # [ 2.742234] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2579gitlab # [ 2.744412] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0580gitlab # [ 2.786714] systemd[1]: Mounting /sysroot...581gitlab # [ 3.131310] EXT4-fs (vda): mounted filesystem 7135057f-9305-4568-9497-d62337950320 r/w with ordered data mode. Quota mode: none.582gitlab # [ 2.897325] systemd[1]: Mounted /sysroot.583gitlab # [ 2.898348] systemd[1]: Reached target Initrd Root File System.584gitlab # [ 2.899543] systemd[1]: Mounting /sysroot/nix/.ro-store...585gitlab # [ 2.900888] systemd[1]: Mounting /sysroot/nix/.rw-store...586gitlab # [ 2.906586] systemd[1]: Mounting /sysroot/run...587gitlab # [ 2.909827] systemd[1]: Mounting /sysroot/tmp/shared...588gitlab # [ 2.912261] systemd[1]: Mounting /sysroot/tmp/xchg...589gitlab # [ 2.915226] systemd[1]: Starting Mountpoints Configured in the Real Root...590gitlab # [ 2.917663] systemd[1]: Mounted /sysroot/nix/.rw-store.591gitlab # [ 2.922930] systemd[1]: Starting rw-sysroot-nix-store.service...592gitlab # [ 3.163628] 9p: Installing v9fs 9p2000 file system support593gitlab # [ 3.165813] erofs (device vdb): mounted with root inode @ nid 128.594gitlab # [ 2.928288] systemd[1]: Mounted /sysroot/run.595gitlab # [ 2.931273] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.596gitlab # [ 2.933361] systemd[1]: Finished rw-sysroot-nix-store.service.597gitlab # [ 2.934878] systemd-sysroot-fstab-check[177]: /sysroot should be mounted in the initrd, will request daemon-reload.598gitlab # [ 2.937369] systemd[1]: Mounted /sysroot/nix/.ro-store.599gitlab # [ 2.938581] systemd[1]: Mounted /sysroot/tmp/shared.600gitlab # [ 2.939744] systemd[1]: Mounted /sysroot/tmp/xchg.601gitlab # [ 2.940917] systemd[1]: Reload requested from client PID 177 ('systemd-sysroot') (unit initrd-parse-etc.service)...602gitlab # [ 2.943277] systemd[1]: Reloading...603gitlab # [ 3.003803] systemd[1]: Reloading finished in 61 ms.604gitlab # [ 3.024471] systemd-sysroot-fstab-check[177]: Requesting initrd-fs.target/start/replace...605gitlab # [ 3.026525] systemd-sysroot-fstab-check[177]: Requesting swap.target/start/replace...606gitlab # [ 3.028038] systemd[1]: Starting rw-sysroot-nix-store.service...607gitlab # [ 3.029261] systemd[1]: initrd-parse-etc.service: Deactivated successfully.608gitlab # [ 3.030524] systemd[1]: Finished Mountpoints Configured in the Real Root.609gitlab # [ 3.031744] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.610gitlab # [ 3.036555] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.611gitlab # [ 3.038107] systemd[1]: Finished rw-sysroot-nix-store.service.612gitlab # [ 3.786844] systemd[1]: Mounting /sysroot/nix/store...613gitlab # [ 3.814976] systemd[1]: Mounted /sysroot/nix/store.614gitlab # [ 3.816277] systemd[1]: Reached target Initrd File Systems.615gitlab # [ 3.817475] systemd[1]: Starting Find NixOS closure...616gitlab # [ 3.818653] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...617gitlab # [ 3.829676] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.618gitlab # [ 3.832531] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.619gitlab # [ 3.836650] systemd[1]: Finished Find NixOS closure.620gitlab # [ 3.839537] systemd[1]: Reached target Initrd Default Target.621gitlab # [ 3.842044] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...622gitlab # [ 3.864377] systemd[1]: Stopped target Initrd Default Target.623gitlab # [ 3.865683] systemd[1]: Stopped target Basic System.624gitlab # [ 3.866766] systemd[1]: Stopped target Initrd Root Device.625gitlab # [ 3.867858] systemd[1]: Stopped target Path Units.626gitlab # [ 3.868863] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.627gitlab # [ 3.870352] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.628gitlab # [ 3.871939] systemd[1]: Stopped target Slice Units.629gitlab # [ 3.872962] systemd[1]: Stopped target Socket Units.630gitlab # [ 3.874048] systemd[1]: Stopped target System Initialization.631gitlab # [ 3.875774] systemd[1]: Stopped target Swaps.632gitlab # [ 3.876717] systemd[1]: Stopped target Timer Units.633gitlab # [ 3.877765] systemd[1]: dbus.socket: Deactivated successfully.634gitlab # [ 3.879053] systemd[1]: Closed D-Bus System Message Bus Socket.635gitlab # [ 3.880531] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.636gitlab # [ 3.882138] systemd[1]: Stopped Find NixOS closure.637gitlab # [ 3.883312] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio638gitlab # [ 3.885474] systemd[1]: Starting rw-sysroot-nix-store.service...639gitlab # [ 3.888972] systemd[1]: systemd-sysctl.service: Deactivated successfully.640gitlab # [ 3.890740] systemd[1]: Stopped Apply Kernel Variables.641gitlab # [ 3.891818] systemd[1]: systemd-modules-load.service: Deactivated successfully.642gitlab # [ 3.893274] systemd[1]: Stopped Load Kernel Modules.643gitlab # [ 3.894313] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.644gitlab # [ 3.895828] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.645gitlab # [ 3.897522] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.646gitlab # [ 3.899212] systemd[1]: Stopped Create System Files and Directories.647gitlab # [ 3.900733] systemd[1]: Stopped target Local File Systems.648gitlab # [ 3.901896] systemd[1]: Stopped target Preparation for Local File Systems.649gitlab # [ 3.903265] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.650gitlab # [ 3.904952] systemd[1]: Stopped Coldplug All udev Devices.651gitlab # [ 3.906238] systemd[1]: Stopping Rule-based Manager for Device Events and Files...652gitlab # [ 3.908059] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.653gitlab # [ 3.909510] systemd[1]: Stopped Virtual Console Setup.654gitlab # [ 3.910631] systemd[1]: initrd-cleanup.service: Deactivated successfully.655gitlab # [ 3.912460] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.656gitlab # [ 3.914256] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.657gitlab # [ 3.917211] systemd[1]: Finished rw-sysroot-nix-store.service.658gitlab # [ 3.919126] systemd[1]: systemd-udevd.service: Deactivated successfully.659gitlab # [ 3.920384] systemd[1]: Stopped Rule-based Manager for Device Events and Files.660gitlab # [ 3.921775] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.661gitlab # [ 3.923442] systemd[1]: Closed udev Control Socket.662gitlab # [ 3.924600] systemd[1]: Starting Cleanup udev Database...663gitlab # [ 3.925704] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.664gitlab # [ 3.927299] systemd[1]: Stopped Create Static Device Nodes in /dev.665gitlab # [ 3.928570] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.666gitlab # [ 3.930124] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.667gitlab # [ 3.931557] systemd[1]: kmod-static-nodes.service: Deactivated successfully.668gitlab # [ 3.932897] systemd[1]: Stopped Create List of Static Device Nodes.669gitlab # [ 3.934122] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.670gitlab # [ 3.935550] systemd[1]: Finished Cleanup udev Database.671gitlab # [ 3.936677] systemd[1]: Reached target Switch Root.672gitlab # [ 3.937745] systemd[1]: Starting NixOS Activation...673gitlab # [ 4.016995] initrd-nixos-activation-start[223]: booting system configuration /nix/store/27j0nac7nl6xj9krs6j1rvbyxldsqv5d-nixos-system-gitlab-test674gitlab # [ 4.039858] initrd-nixos-activation-start[223]: running activation script...675gitlab # [ 4.216327] initrd-nixos-activation-start[246]: setting up /etc...676gitlab # [ 4.307495] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.677gitlab # [ 4.309389] systemd[1]: Finished NixOS Activation.678gitlab # [ 4.310558] systemd[1]: Starting Switch Root...679gitlab # [ 4.328551] systemd[1]: Switching root.680gitlab # [ 4.629235] systemd-journald[92]: Received SIGTERM from PID 1 (systemd).681gitlab # [ 4.692958] NET: Registered PF_VSOCK protocol family682gitlab # [ 5.051088] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)683gitlab # [ 5.056565] systemd[1]: Detected virtualization kvm.684gitlab # [ 5.057806] systemd[1]: Detected architecture x86-64.685gitlab # [ 5.058938] systemd[1]: Detected first boot.686gitlab # [ 5.060251] systemd[1]: Initializing machine ID from random generator.687gitlab # [ 5.173443] systemd[1]: bpf-restrict-fs: LSM BPF program attached688gitlab # [ 5.228112] systemd[1]: Applying preset policy.689gitlab # [ 5.316103] systemd[1]: Populated /etc with preset unit settings.690gitlab # [ 5.455449] systemd[1]: initrd-switch-root.service: Deactivated successfully.691gitlab # [ 5.457928] systemd[1]: Stopped initrd-switch-root.service.692gitlab # [ 5.461820] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.693gitlab # [ 5.465381] systemd[1]: Created slice Slice /system/getty.694gitlab # [ 5.467685] systemd[1]: Created slice GitLab DevOps Platform Slice.695gitlab # [ 5.470042] systemd[1]: Created slice User and Session Slice.696gitlab # [ 5.471771] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.697gitlab # [ 5.474355] systemd[1]: Started Forward Password Requests to Wall Directory Watch.698gitlab # [ 5.476356] systemd[1]: Expecting device /dev/hvc0...699gitlab # [ 5.477739] systemd[1]: Expecting device /dev/ttyS0...700gitlab # [ 5.479223] systemd[1]: Reached target Local Encrypted Volumes.701gitlab # [ 5.480847] systemd[1]: Stopped target initrd-fs.target.702gitlab # [ 5.482430] systemd[1]: Stopped target initrd-root-fs.target.703gitlab # [ 5.483976] systemd[1]: Stopped target initrd-switch-root.target.704gitlab # [ 5.485632] systemd[1]: Reached target Virtual Machines and Containers.705gitlab # [ 5.487411] systemd[1]: Reached target Path Units.706gitlab # [ 5.488775] systemd[1]: Reached target Remote File Systems.707gitlab # [ 5.490319] systemd[1]: Reached target Slice Units.708gitlab # [ 5.491732] systemd[1]: Reached target Swaps.709gitlab # [ 5.494346] systemd[1]: Listening on Query the User Interactively for a Password.710gitlab # [ 5.497703] systemd[1]: Listening on Process Core Dump Socket.711gitlab # [ 5.500294] systemd[1]: Listening on Credential Encryption/Decryption.712gitlab # [ 5.503374] systemd[1]: Listening on Factory Reset Management.713gitlab # [ 5.505279] systemd[1]: Listening on Hostname Service Socket.714gitlab # [ 5.509321] systemd[1]: Starting Journal Log Access Socket...715gitlab # [ 5.511576] systemd[1]: Listening on Journal Audit Socket.716gitlab # [ 5.514965] systemd[1]: Listening on Console Output Muting Service Socket.717gitlab # [ 5.517137] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.718gitlab # [ 5.519120] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os719gitlab # [ 5.521218] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki720gitlab # [ 5.524910] systemd[1]: Listening on Disk Repartitioning Service Socket.721gitlab # [ 5.526678] systemd[1]: Listening on udev Control Socket.722gitlab # [ 5.528258] systemd[1]: Listening on udev Varlink Socket.723gitlab # [ 5.531758] systemd[1]: Mounting Huge Pages File System...724gitlab # [ 5.534800] systemd[1]: Mounting POSIX Message Queue File System...725gitlab # [ 5.544728] systemd[1]: Mounting Kernel Debug File System...726gitlab # [ 5.548480] systemd[1]: Mounting Kernel Trace File System...727gitlab # [ 5.552535] systemd[1]: Starting Create List of Static Device Nodes...728gitlab # [ 5.559702] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio729gitlab # [ 5.563480] systemd[1]: Starting Load Kernel Module configfs...730gitlab # [ 5.564855] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm731gitlab # [ 5.566768] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore732gitlab # [ 5.568866] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse733gitlab # [ 5.572298] systemd[1]: Mounting FUSE Control File System...734gitlab # [ 5.573539] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67735gitlab # [ 5.582963] systemd[1]: Starting Journal Service...736gitlab # [ 5.584992] systemd[1]: Starting Load Kernel Modules...737gitlab # [ 5.591927] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...738gitlab # [ 5.595135] systemd[1]: Starting Remount Root and Kernel File Systems...739gitlab # [ 5.596455] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os740gitlab # [ 5.601203] systemd[1]: Starting Coldplug All udev Devices...741gitlab # [ 5.607367] systemd[1]: Listening on Journal Log Access Socket.742gitlab # [ 5.609111] systemd[1]: Mounted Huge Pages File System.743gitlab # [ 5.609314] systemd-journald[316]: Collecting audit messages is enabled.744gitlab # [ 5.609669] systemd[1]: Mounted POSIX Message Queue File System.745gitlab # [ 5.612384] loop: module loaded746gitlab # [ 5.612926] systemd[1]: Mounted Kernel Debug File System.747gitlab # [ 5.615709] systemd[1]: Mounted Kernel Trace File System.748gitlab # [ 5.617560] systemd[1]: Finished Create List of Static Device Nodes.749gitlab # [ 5.619232] systemd[1]: modprobe@configfs.service: Deactivated successfully.750gitlab # [ 5.621097] EXT4-fs (vda): re-mounted 7135057f-9305-4568-9497-d62337950320.751gitlab # [ 5.621375] systemd[1]: Finished Load Kernel Module configfs.752gitlab # [ 5.624775] systemd[1]: Mounted FUSE Control File System.753gitlab # [ 5.626873] systemd[1]: Finished Load Kernel Modules.754gitlab # [ 5.390098] systemd[1]: Queued start job for default target Multi-User System.755gitlab # [ 5.629602] systemd[1]: Started Journal Service.756gitlab # [ 5.392053] systemd[1]: Unnecessary job was removed for /dev/vdb.757gitlab # [ 5.394264] systemd[1]: systemd-journald.service: Deactivated successfully.758gitlab # [ 5.396073] systemd-modules-load[317]: Using 3 probe threads759gitlab # [ 5.397521] systemd-modules-load[317]: Inserted module 'tls'760gitlab # [ 5.398987] systemd-modules-load[317]: Inserted module 'loop'761gitlab # [ 5.401036] systemd[1]: Finished Remount Root and Kernel File Systems.762gitlab # [ 5.405800] systemd-oomd[319]: No swap; memory pressure usage will be degraded763gitlab # [ 5.407890] systemd[1]: Listening on Disk Image Download Service Socket.764gitlab # [ 5.411123] systemd[1]: Mounting Kernel Configuration File System...765gitlab # [ 5.412763] systemd[1]: Starting Firewall...766gitlab # [ 5.418813] systemd[1]: Starting Flush Journal to Persistent Storage...767gitlab # [ 5.420120] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore768gitlab # [ 5.423225] systemd[1]: Starting Load/Save OS Random Seed...769gitlab # [ 5.674836] systemd-journald[316]: Received client request to flush runtime journal.770gitlab # [ 5.493854] systemd[1]: Starting Apply Kernel Variables...771gitlab # [ 5.496098] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...772gitlab # [ 5.498117] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os773gitlab # [ 5.500327] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.774gitlab # [ 5.502090] systemd[1]: Mounted Kernel Configuration File System.775gitlab # [ 5.503884] systemd[1]: Finished Load/Save OS Random Seed.776gitlab # [ 5.505143] systemd[1]: Reached target First Boot Complete.777gitlab # [ 5.506512] systemd[1]: Finished Apply Kernel Variables.778gitlab # [ 5.507978] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.779gitlab # [ 5.509689] systemd[1]: Starting Create Static Device Nodes in /dev...780gitlab # [ 5.511157] systemd[1]: Finished Coldplug All udev Devices.781gitlab # [ 5.513270] systemd[1]: Finished Create Static Device Nodes in /dev.782gitlab # [ 5.514767] systemd[1]: Reached target Preparation for Local File Systems.783gitlab # [ 5.516326] systemd[1]: Starting Rule-based Manager for Device Events and Files...784gitlab # [ 5.517990] systemd[1]: Finished Flush Journal to Persistent Storage.785gitlab # [ 5.519732] systemd-udevd[356]: Using default interface naming scheme 'v261'.786gitlab # [ 5.547565] systemd[1]: Started Rule-based Manager for Device Events and Files.787gitlab # [ 5.639883] systemd[1]: Finished Firewall.788gitlab # [ 5.642602] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse789gitlab # [ 5.663166] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.790gitlab # [ 5.676765] (udev-worker)[452]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.791gitlab # [ 5.679772] (udev-worker)[452]: Network interface NamePolicy= disabled on kernel command line.792gitlab # [ 5.691089] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.793gitlab # [ 5.694961] systemd[1]: Condition check resulted in Virtio network device being skipped.794gitlab # [ 5.697209] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore795gitlab # [ 5.700120] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67796gitlab # [ 5.703912] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore797gitlab # [ 5.706423] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os798gitlab # [ 5.708459] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os799gitlab # [ 5.714686] (udev-worker)[446]: Network interface NamePolicy= disabled on kernel command line.800gitlab # [ 5.974991] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3801gitlab # [ 5.982942] mousedev: PS/2 mouse device common for all mice802gitlab # [ 5.984480] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0803gitlab # [ 5.986272] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD804gitlab # [ 5.991123] ACPI: button: Power Button [PWRF]805gitlab # [ 5.991209] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console806gitlab # [ 5.999814] Console: switching to colour dummy device 80x25807gitlab # [ 6.000713] [drm] Found bochs VGA, ID 0xb0c5.808gitlab # [ 6.000715] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.809gitlab # [ 6.002626] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic810gitlab # [ 6.003713] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0811gitlab # [ 6.011341] Floppy drive(s): fd0 is 2.88M AMI BIOS812gitlab # [ 6.027282] FDC 0 is a S82078B813gitlab # [ 6.029881] Console: switching to colour frame buffer device 160x50814gitlab # [ 6.033760] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device815gitlab # [ 6.035492] rtc_cmos 00:05: RTC can wake from S4816gitlab # [ 6.037981] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4817gitlab # [ 6.038296] rtc_cmos 00:05: registered as rtc0818gitlab # [ 6.039957] rtc_cmos 00:05: setting system clock to 2026-08-13T13:12:51 UTC (1786626771)819gitlab # [ 6.041380] systemd-journald[316]: Time jumped backwards, rotating.820gitlab # [ 6.042872] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs821gitlab # [ 6.051122] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6822gitlab # [ 6.053833] parport_pc 00:03: reported by Plug and Play ACPI823gitlab # [ 6.056717] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]824gitlab # [ 6.057791] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5825gitlab # [ 5.873863] systemd[1]: Starting Virtual Console Setup...826gitlab # [ 6.143066] erofs (device vdb): failed to read inode meta block (nid: 127577088): -4827gitlab # [ 5.907923] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.828gitlab # [ 5.909529] systemd[1]: Stopped Virtual Console Setup.829gitlab # [ 5.917537] systemd[1]: Starting Virtual Console Setup...830gitlab # [ 5.922372] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.831gitlab # [ 5.923845] systemd[1]: Stopped Virtual Console Setup.832gitlab # [ 5.927972] systemd[1]: Starting Virtual Console Setup...833gitlab # [ 6.193751] ppdev: user-space parallel port driver834gitlab # [ 6.218369] kvm_amd: TSC scaling supported835gitlab # [ 6.219468] kvm_amd: Nested Virtualization enabled836gitlab # [ 6.220557] kvm_amd: Nested Paging enabled837gitlab # [ 6.221333] kvm_amd: LBR virtualization supported838gitlab # [ 6.222164] kvm_amd: Virtual VMLOAD VMSAVE supported839gitlab # [ 5.983741] s[ 6.222867] kvm_amd: Virtual GIF supported840gitlab # ystemd-vconsole-setup[492]: Configuration of first virtual console was skipped, ignoring remaining ones.841gitlab # [ 5.988454] systemd[1]: Finished Virtual Console Setup.842gitlab # [ 6.268356] EDAC MC: Ver: 3.0.0843gitlab # [ 6.219203] systemd[1]: Mounting /run/wrappers...844gitlab # [ 6.238560] systemd[1]: Mounted /run/wrappers.845gitlab # [ 6.239819] systemd[1]: Reached target Local File Systems.846gitlab # [ 6.241193] systemd[1]: Listening on Boot Loader Control Service Socket.847gitlab # [ 6.243081] systemd[1]: Starting register-nix-paths.service...848gitlab # [ 6.244591] systemd[1]: Starting Create SUID/SGID Wrappers...849gitlab # [ 6.246240] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.850gitlab # [ 6.248377] systemd[1]: Starting Save Transient machine-id to Disk...851gitlab # [ 6.255139] systemd[1]: Starting Create System Files and Directories...852gitlab # [ 6.275674] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.853gitlab # [ 6.278116] systemd[1]: Finished Create System Files and Directories.854gitlab # [ 6.280078] systemd[1]: Finished Save Transient machine-id to Disk.855gitlab # [ 6.283571] systemd[1]: Starting Rebuild Journal Catalog...856gitlab # [ 6.285748] systemd[1]: Starting Record System Boot/Shutdown in UTMP...857gitlab # [ 6.300236] systemd[1]: Finished Record System Boot/Shutdown in UTMP.858gitlab # [ 6.310467] systemd[1]: Finished Rebuild Journal Catalog.859gitlab # [ 6.312763] systemd[1]: Starting Update is Completed...860gitlab # [ 6.330594] systemd[1]: Finished Update is Completed.861gitlab # [ 6.342418] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.862gitlab # [ 6.344004] systemd[1]: Finished Create SUID/SGID Wrappers.863gitlab # [ 6.598437] systemd[1]: Finished register-nix-paths.service.864gitlab # [ 6.599721] systemd[1]: Reached target System Initialization.865gitlab # [ 6.601088] systemd[1]: Started Discard unused filesystem blocks once a week.866gitlab # [ 6.602684] systemd[1]: Started logrotate.timer.867gitlab # [ 6.603777] systemd[1]: Started Daily Cleanup of Temporary Directories.868gitlab # [ 6.605265] systemd[1]: Reached target Timer Units.869gitlab # [ 6.606416] systemd[1]: Listening on D-Bus System Message Bus Socket.870gitlab # [ 6.607855] systemd[1]: Listening on Nix Daemon Socket.871gitlab # [ 6.611446] systemd[1]: Starting nixbot CI service socket...872gitlab # [ 6.612612] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.873gitlab # [ 6.614288] systemd[1]: Listening on nixbot CI service socket.874gitlab # [ 6.615500] systemd[1]: Reached target Socket Units.875gitlab # [ 6.616585] systemd[1]: Starting D-Bus System Message Bus...876gitlab # [ 6.646752] dbus-broker-launch[574]: Looking up NSS user entry for 'systemd-timesync'...877gitlab # [ 6.648713] dbus-broker-launch[574]: NSS returned no entry for 'systemd-timesync'878gitlab # [ 6.650279] dbus-broker-launch[574]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"879gitlab # [ 6.653469] systemd[1]: Started D-Bus System Message Bus.880gitlab # [ 6.658913] dbus-broker-launch[574]: Ready881gitlab # [ 6.662063] systemd[1]: Reached target Basic System.882gitlab # [ 6.663570] systemd[1]: Started backdoor.service.883gitlab # [ 6.665664] systemd[1]: Starting gitlab-config.service...884gitlab # [ 6.667537] systemd[1]: Starting Import lastlog data into lastlog2 database...885gitlab # [ 6.673597] systemd[1]: Starting Logrotate configuration check...886gitlab # [ 6.676183] systemd[1]: Starting Name Service Cache Daemon (nsncd)...887gitlab # [ 6.684255] systemd[1]: Starting Post-Boot Actions...888gitlab # [ 6.685672] systemd[1]: Started Reset console on configuration changes.889gitlab # [ 6.688898] systemd[1]: Starting resolvconf update...890gitlab # [ 6.692363] logrotate[579]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.891gitlab # [ 6.695697] logrotate[579]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf892gitlab # connecting to host...893gitlab # [ 6.696743] logrotate[579]: note: 'monthly' overrides previously specified 'weekly'894gitlab # [ 6.701207] logrotate[579]: Reading state from file: /var/lib/logrotate.status895gitlab # [ 6.701956] logrotate[579]: state file /var/lib/logrotate.status does not exist896gitlab: Guest shell says: b'Spawning backdoor root shell...\n'897gitlab # [ 6.706223] logrotate[579]: Allocating hash table for state file, size 64 entries898gitlab # [ 6.706851] logrotate[579]: Handling 4 logs899gitlab # [ 6.707835] logrotate[579]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed900gitlab # [ 6.708553] logrotate[579]: considering log /var/log/btmp901gitlab # [ 6.709318] logrotate[579]: Creating new state902gitlab # [ 6.710038] logrotate[579]: Now: 2026-08-13 13:12903gitlab # [ 6.710752] logrotate[579]: Last rotated at 2026-08-13 13:00904gitlab # [ 6.711722] logrotate[579]: log does not need rotating (log has already been rotated)905gitlab: connected to guest root shell906gitlab # [ 6.712706] logrotate[579]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed907gitlab # [ 6.713720] logrotate[579]: considering log /var/log/wtmp908gitlab # [ 6.714634] logrotate[579]: Creating new state909gitlab # [ 6.715936] logrotate[579]: Now: 2026-08-13 13:12910gitlab # [ 6.716742] logrotate[579]: Last rotated at 2026-08-13 13:00911gitlab # [ 6.717506] logrotate[579]: log does not need rotating (log has already been rotated)912gitlab # [ 6.718121] logrotate[579]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed913gitlab # [ 6.718673] logrotate[579]: switching euid from 0 to 165 and egid from 0 to 165 (pid 579)914gitlab: (connecting took 7.60 seconds)915gitlab: (finished: waiting for the VM to finish booting, in 7.60 seconds)916gitlab # [ 6.719089] logrotate[579]: considering log /var/gitlab/state/log/*.log917gitlab # [ 6.719634] logrotate[579]: log /var/gitlab/state/log/*.log does not exist -- skipping918gitlab # [ 6.720247] logrotate[579]: Creating new state919gitlab # [ 6.720803] logrotate[579]: switching euid from 165 to 0 and egid from 165 to 0 (pid 579)920gitlab # [ 6.721643] logrotate[579]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed921gitlab # [ 6.722541] logrotate[579]: switching euid from 0 to 60 and egid from 0 to 60 (pid 579)922gitlab # [ 6.723297] logrotate[579]: considering log /var/log/nginx/*.log923gitlab # [ 6.723884] logrotate[579]: log /var/log/nginx/*.log does not exist -- skipping924gitlab # [ 6.724834] logrotate[579]: Creating new state925gitlab # [ 6.725767] logrotate[579]: not running postrotate script, since no logs were rotated926gitlab # [ 6.726575] logrotate[579]: switching euid from 60 to 0 and egid from 60 to 0 (pid 579)927gitlab # [ 6.727795] systemd[1]: Finished Logrotate configuration check.928gitlab # [ 6.730333] nsncd[580]: Aug 13 13:12:52.402 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"929gitlab # [ 6.731970] systemd[1]: Started Name Service Cache Daemon (nsncd).930gitlab # [ 6.753941] systemd[1]: Finished Post-Boot Actions.931gitlab # [ 6.760254] systemd[1]: Finished Import lastlog data into lastlog2 database.932gitlab # [ 6.773331] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...933gitlab # [ 6.774473] systemd[1]: nscd.service: Deactivated successfully.934gitlab # [ 6.779912] systemd[1]: Stopped Name Service Cache Daemon (nsncd).935gitlab # [ 6.781334] systemd[1]: nscd.service: Consumed 15ms CPU time over 98ms wall clock time, 7.2M memory peak, 5.5M read from disk.936gitlab # [ 6.789117] systemd[1]: Starting Name Service Cache Daemon (nsncd)...937gitlab # [ 6.792954] systemd[1]: Finished resolvconf update.938gitlab # [ 6.794084] systemd[1]: Reached target Preparation for Network.939gitlab # [ 6.798986] systemd[1]: Starting DHCP Client...940gitlab # [ 6.799865] systemd[1]: Starting Address configuration of eth1...941gitlab # [ 6.807322] systemd[1]: Starting Extra networking commands....942gitlab # [ 6.809443] systemd[1]: Started Name Service Cache Daemon (nsncd).943gitlab # [ 6.811609] nsncd[668]: Aug 13 13:12:52.509 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"944gitlab # [ 6.814677] systemd[1]: Reached target Host and Network Name Lookups.945gitlab # [ 6.816031] systemd[1]: Reached target User and Group Name Lookups.946gitlab # [ 6.818286] systemd[1]: Starting User Login Management...947gitlab # [ 6.825388] network-addresses-eth1-start[677]: adding address 192.168.1.1/24... done948gitlab # [ 6.829449] network-addresses-eth1-start[677]: adding address 2001:db8:1::1/64... done949gitlab # [ 6.837589] systemd[1]: Finished Address configuration of eth1.950gitlab # [ 6.862836] systemd-logind[692]: New seat seat0.951gitlab # [ 6.865504] systemd-logind[692]: Watching system buttons on /dev/input/event2 (Power Button)952gitlab # [ 6.867522] systemd-logind[692]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)953gitlab # [ 6.869871] systemd-logind[692]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)954gitlab # [ 6.872299] systemd[1]: Started User Login Management.955gitlab # [ 6.877118] systemd[1]: Starting linger-users.service...956gitlab # [ 6.882690] dhcpcd[698]: dhcpcd-10.3.2 starting957gitlab # [ 6.884965] dhcpcd[756]: dev: loaded udev958gitlab # [ 7.130238] 8021q: 802.1Q VLAN Support v1.8959gitlab # [ 7.130857] 8021q: adding VLAN 0 to HW filter on device eth1960gitlab # [ 6.893249] systemd[1]: Finished Extra networking commands..961gitlab # [ 6.897071] systemd[1]: linger-users.service: Deactivated successfully.962gitlab # [ 6.898557] systemd[1]: Finished linger-users.service.963gitlab # [ 6.899791] systemd[1]: Reached target Network.964gitlab # [ 6.901575] systemd[1]: Starting gitlab-workhorse.service...965gitlab # [ 6.904893] systemd[1]: Starting Nginx Web Server...966gitlab # [ 6.908375] systemd[1]: Starting PostgreSQL Server...967gitlab # [ 6.910549] systemd[1]: Starting Redis Server - redis-gitlab...968gitlab # [ 6.915153] systemd[1]: Starting Permit User Sessions...969gitlab # [ 6.924101] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.970gitlab # [ 6.926163] systemd[1]: Finished Permit User Sessions.971gitlab # [ 6.941469] systemd[1]: Started Getty on tty1.972gitlab # [ 6.942356] systemd[1]: Reached target Login Prompts.973gitlab # [ 7.222994] cfg80211: Loading compiled-in X.509 certificates for regulatory database974gitlab # [ 7.230358] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'975gitlab # [ 7.232458] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'976gitlab # [ 7.235422] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2977gitlab # [ 7.237138] cfg80211: failed to load regulatory.db978gitlab # [ 7.257149] 8021q: adding VLAN 0 to HW filter on device eth0979gitlab # [ 7.021920] dhcpcd[756]: eth0: waiting for carrier980gitlab # [ 7.024776] dhcpcd[756]: eth0: carrier acquired981gitlab # [ 7.026310] dhcpcd[756]: DUID 00:01:00:01:32:10:7f:54:52:54:00:12:34:56982gitlab # [ 7.029183] dhcpcd[756]: eth0: IAID 00:12:34:56983gitlab # [ 7.029964] dhcpcd[756]: eth0: adding address fe80::5054:ff:fe12:3456984gitlab # [ 7.044912] nginx-pre-start[790]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok985gitlab # [ 7.046166] nginx-pre-start[790]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful986gitlab # [ 7.051083] systemd[1]: Started Nginx Web Server.987gitlab # [ 7.060607] redis-server[786]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.988gitlab # [ 7.064946] redis-server[786]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo989gitlab # [ 7.067175] systemd[1]: Started Redis Server - redis-gitlab.990gitlab # [ 7.067687] redis-server[786]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=786, just started991gitlab # [ 7.068876] redis-server[786]: Configuration loaded992gitlab # [ 7.070178] redis[786]: monotonic clock: POSIX clock_gettime993gitlab # [ 7.073381] redis[786]: Running mode=standalone, port=0.994gitlab # [ 7.073983] redis[786]: Server initialized995gitlab # [ 7.075173] redis[786]: Ready to accept connections unix996gitlab # [ 7.075857] redis[786]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.997gitlab # [ 7.088481] postgresql-pre-start[798]: The files belonging to this database system will be owned by user "postgres".998gitlab # [ 7.089052] postgresql-pre-start[798]: This user must also own the server process.999gitlab # [ 7.091509] postgresql-pre-start[798]: The database cluster will be initialized with locale "en_US.UTF-8".1000gitlab # [ 7.092631] postgresql-pre-start[798]: The default database encoding has accordingly been set to "UTF8".1001gitlab # [ 7.093633] postgresql-pre-start[798]: The default text search configuration will be set to "english".1002gitlab # [ 7.095143] postgresql-pre-start[798]: Data page checksums are enabled.1003gitlab # [ 7.096050] postgresql-pre-start[798]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1004gitlab # [ 7.096921] postgresql-pre-start[798]: creating subdirectories ... ok1005gitlab # [ 7.097969] postgresql-pre-start[798]: selecting dynamic shared memory implementation ... posix1006gitlab # [ 7.135639] postgresql-pre-start[798]: selecting default "max_connections" ... 1001007gitlab # [ 7.174761] postgresql-pre-start[798]: selecting default "shared_buffers" ... 128MB1008gitlab # [ 7.402811] postgresql-pre-start[798]: selecting default time zone ... UTC1009gitlab # [ 7.405329] postgresql-pre-start[798]: creating configuration files ... ok1010gitlab # [ 7.410234] systemd[1]: Started gitlab-workhorse.service.1011gitlab # [ 7.568819] postgresql-pre-start[798]: running bootstrap script ... ok1012gitlab # [ 7.644191] gitlab-workhorse[822]: time="2026-08-13T13:12:53Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41013gitlab # [ 7.644678] gitlab-workhorse[822]: time="2026-08-13T13:12:53Z" level=info msg="Using redis/go-redis"1014gitlab # [ 7.647886] gitlab-workhorse[822]: time="2026-08-13T13:12:53Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1015gitlab # [ 7.934583] dhcpcd[756]: eth0: soliciting a DHCP lease1016gitlab # [ 8.177778] NET: Registered PF_PACKET protocol family1017gitlab # [ 7.957598] dhcpcd[756]: eth0: offered 10.0.2.15 from 10.0.2.21018gitlab # [ 7.964396] dhcpcd[756]: eth0: probing address 10.0.2.15/241019gitlab # [ 8.069657] postgresql-pre-start[798]: performing post-bootstrap initialization ... ok1020gitlab # [ 8.277940] postgresql-pre-start[798]: syncing data to disk ... ok1021gitlab # [ 8.279346] postgresql-pre-start[798]: initdb: warning: enabling "trust" authentication for local connections1022gitlab # [ 8.281145] postgresql-pre-start[798]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1023gitlab # [ 8.283898] postgresql-pre-start[798]: Success. You can now start the database server using:1024gitlab # [ 8.285363] postgresql-pre-start[798]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1025gitlab # [ 8.338973] postgres[847]: [847] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1026gitlab # [ 8.341830] postgres[847]: [847] LOG: listening on IPv6 address "::1", port 54321027gitlab # [ 8.343689] postgres[847]: [847] LOG: listening on IPv4 address "127.0.0.1", port 54321028gitlab # [ 8.345516] postgres[847]: [847] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1029gitlab # [ 8.347977] postgres[857]: [857] LOG: database system was shut down at 2026-08-13 13:12:53 GMT1030gitlab # [ 8.351729] postgres[847]: [847] LOG: database system is ready to accept connections1031gitlab # [ 8.356425] systemd[1]: Started PostgreSQL Server.1032gitlab # [ 8.360346] systemd[1]: Starting PostgreSQL Setup Scripts...1033gitlab # [ 8.495084] postgresql-setup-start[868]: CREATE DATABASE1034gitlab # [ 8.511571] postgresql-setup-start[873]: CREATE ROLE1035gitlab # [ 8.521453] postgresql-setup-start[875]: ALTER DATABASE1036gitlab # [ 8.537240] postgresql-setup-start[880]: CREATE ROLE1037gitlab # [ 8.541156] systemd[1]: Finished PostgreSQL Setup Scripts.1038gitlab # [ 8.541694] systemd[1]: Reached target PostgreSQL.1039gitlab # [ 8.543795] systemd[1]: Starting gitlab-postgresql.service...1040gitlab # [ 8.625352] gitlab-postgresql-start[888]: CREATE DATABASE1041gitlab # [ 8.653644] gitlab-postgresql-start[896]: CREATE EXTENSION1042gitlab # [ 8.719282] gitlab-postgresql-start[899]: CREATE EXTENSION1043gitlab # [ 8.724117] systemd[1]: Finished gitlab-postgresql.service.1044gitlab # [ 8.746564] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[893]: mkdir -p /var/gitlab/state/home/.ssh: OK1045gitlab # [ 8.747731] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[893]: chmod 700 /var/gitlab/state/home/.ssh: OK1046gitlab # [ 8.784801] systemd[1]: Finished gitlab-config.service.1047gitlab # [ 8.787107] systemd[1]: Started gitaly.service.1048gitlab # [ 8.788536] systemd[1]: Starting gitlab-db-config.service...1049gitlab # [ 9.339948] gitaly[914]: time="2026-08-13T13:12:55.037Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9141050gitlab # [ 9.340841] gitaly[914]: time="2026-08-13T13:12:55.037Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9141051gitlab # [ 9.341948] gitaly[914]: time="2026-08-13T13:12:55.037Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9141052gitlab # [ 9.342891] gitaly[914]: time="2026-08-13T13:12:55.037Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9141053gitlab # [ 9.343896] gitaly[914]: time="2026-08-13T13:12:55.038Z" level=info msg="Starting Gitaly" pid=914 version=1054gitlab # [ 9.551965] gitaly[914]: time="2026-08-13T13:12:55.249Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=196 pid=9141055gitlab # [ 9.552741] gitaly[914]: time="2026-08-13T13:12:55.250Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9141056gitlab # [ 9.558511] gitaly[914]: time="2026-08-13T13:12:55.256Z" level=info msg="finished initializing command factory" duration_ms=6 pid=9141057gitlab # [ 9.559234] gitaly[914]: time="2026-08-13T13:12:55.256Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-914/git-exec-916385908.d/git pid=9141058gitlab # [ 9.569191] gitaly[914]: time="2026-08-13T13:12:55.267Z" level=info msg="finished detecting git version" duration_ms=10 pid=9141059gitlab # [ 9.569966] gitaly[914]: time="2026-08-13T13:12:55.267Z" level=info msg="using Git version" pid=914 version=2.53.g1060gitlab # [ 9.574550] gitaly[914]: time="2026-08-13T13:12:55.272Z" level=info msg="clearing disk cache object folder" pid=914 storage=default1061gitlab # [ 9.574997] gitaly[914]: time="2026-08-13T13:12:55.272Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3776183769 pid=914 storage=default1062gitlab # [ 9.576680] gitaly[914]: time="2026-08-13T13:12:55.272Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3776183769 pid=914 storage=default1063gitlab # [ 9.577491] gitaly[914]: time="2026-08-13T13:12:55.272Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9141064gitlab # [ 9.580132] gitaly[914]: time="2026-08-13T13:12:55.272Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9141065gitlab # [ 9.581324] gitaly[914]: time="2026-08-13T13:12:55.273Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3776183769 clear_duration_ms=0 pid=914 storage=default1066gitlab # [ 9.598564] dhcpcd[756]: eth0: soliciting an IPv6 router1067gitlab # [ 9.599257] dhcpcd[756]: eth0: Router Advertisement from fe80::21068gitlab # [ 9.599882] dhcpcd[756]: eth0: adding address fec0::5054:ff:fe12:3456/641069gitlab # [ 9.600705] dhcpcd[756]: eth0: adding route to fec0::/641070gitlab # [ 9.601634] dhcpcd[756]: eth0: adding default route via fe80::21071gitlab # [ 9.633712] gitaly[914]: time="2026-08-13T13:12:55.331Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9141072gitlab # [ 9.634782] gitaly[914]: time="2026-08-13T13:12:55.331Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=914 schema=unix1073gitlab # [ 9.635969] gitaly[914]: time="2026-08-13T13:12:55.332Z" level=info msg="counting repositories" pid=9141074gitlab # [ 9.637188] gitaly[914]: time="2026-08-13T13:12:55.333Z" level=info msg="starting to count repositories" pid=914 storage_path=/var/gitlab/state/repositories1075gitlab # [ 9.638125] gitaly[914]: time="2026-08-13T13:12:55.334Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=914 storage_path=/var/gitlab/state/repositories1076gitlab # [ 9.639102] gitaly[914]: time="2026-08-13T13:12:55.334Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9141077gitlab # [ 9.639696] gitaly[914]: time="2026-08-13T13:12:55.333Z" level=info msg="finished tempdir cleaner walk" pid=914 storage=default time_ms=01078gitlab # [ 9.653306] gitaly[914]: time="2026-08-13T13:12:55.351Z" level=info msg="listening at address" address=/run/gitaly/gitaly-914/sock.d/intern pid=914 schema=unix1079gitlab # [ 9.656331] gitaly[914]: time="2026-08-13T13:12:55.354Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9141080gitlab # [ 9.656942] gitaly[914]: time="2026-08-13T13:12:55.354Z" level=info msg="Started Gitaly" duration_ms=316 pid=9141081gitlab # [ 9.657944] gitaly[914]: time="2026-08-13T13:12:55.354Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9141082gitlab # [ 9.658818] gitaly[914]: time="2026-08-13T13:12:55.354Z" level=info msg="maintenance: daily scheduled" pid=914 scheduled="2026-08-14 12:00:00 +0000 UTC"1083gitlab # [ 9.970599] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1084gitlab # [ 9.971211] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1085gitlab # [ 9.984483] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1086gitlab # [ 12.310665] dhcpcd[756]: eth0: leased 10.0.2.15 for 86400 seconds1087gitlab # [ 12.311466] dhcpcd[756]: eth0: adding route to 10.0.2.0/241088gitlab # [ 12.312191] dhcpcd[756]: eth0: adding default route via 10.0.2.21089gitlab # [ 12.360690] systemd[1]: Started DHCP Client.1090gitlab # [ 12.361186] systemd[1]: Reached target Network is Online.1091gitlab # [ 12.842135] gitaly[914]: time="2026-08-13T13:12:58.539Z" level=info msg="License database preloaded" duration_ms=3501 pid=9141092gitlab # [ 46.777335] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[921]: W, [2026-08-13T13:13:32.474950 #921] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1093gitlab # [ 47.708757] gitlab-workhorse[822]: time="2026-08-13T13:13:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1094gitlab # [ 48.965286] postgres[1376]: [1376] ERROR: relation "feature_gates" does not exist at character 5231095gitlab # [ 48.966075] postgres[1376]: [1376] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1096gitlab # [ 48.966811] postgres[1376]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1097gitlab # [ 48.968100] postgres[1376]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1098gitlab # [ 48.969154] postgres[1376]: attidentity AS identity,1099gitlab # [ 48.970071] postgres[1376]: attgenerated as attgenerated1100gitlab # [ 48.971104] postgres[1376]: FROM pg_attribute a1101gitlab # [ 48.972098] postgres[1376]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1102gitlab # [ 48.973056] postgres[1376]: LEFT JOIN pg_type t ON a.atttypid = t.oid1103gitlab # [ 48.973899] postgres[1376]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1104gitlab # [ 48.975083] postgres[1376]: WHERE a.attrelid = '"feature_gates"'::regclass1105gitlab # [ 48.975952] postgres[1376]: AND a.attnum > 0 AND NOT a.attisdropped1106gitlab # [ 48.977119] postgres[1376]: ORDER BY a.attnum1107gitlab # [ 48.977975] postgres[1376]:1108gitlab # [ 53.799303] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1418]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1109gitlab # [ 53.800096] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1418]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1110gitlab # [ 57.719348] gitlab-workhorse[822]: time="2026-08-13T13:13:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1111gitlab # [ 67.729310] gitlab-workhorse[822]: time="2026-08-13T13:13:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1112gitlab # [ 73.014830] postgres[1520]: [1520] ERROR: relation "table_without_models" does not exist1113gitlab # [ 73.016505] postgres[1520]: [1520] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1114gitlab # [ 77.730296] gitlab-workhorse[822]: time="2026-08-13T13:14:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1115gitlab # [ 87.740426] gitlab-workhorse[822]: time="2026-08-13T13:14:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1116gitlab # [ 88.306118] systemd[1]: Finished gitlab-db-config.service.1117gitlab # [ 88.308976] systemd[1]: Started gitlab-sidekiq.service.1118gitlab # [ 88.310504] systemd[1]: Starting gitlab.service...1119gitlab # [ 88.782224] bundle[1732]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1120gitlab # [ 88.782965] bundle[1732]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1121gitlab # [ 88.789791] bundle[1732]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1122gitlab # [ 92.386401] sidekiq-cluster[1731]: {"severity":"INFO","time":"2026-08-13T13:14:18.052Z","message":"Starting cluster with 1 processes"}1123gitlab # [ 92.466560] bundle[1732]: {"timestamp":"2026-08-13T13:14:18.142Z","pid":1732,"message":"* Enabling systemd notification integration"}1124gitlab # [ 92.467044] bundle[1732]: {"timestamp":"2026-08-13T13:14:18.164Z","pid":1732,"message":"Puma starting in cluster mode..."}1125gitlab # [ 92.467584] bundle[1732]: {"timestamp":"2026-08-13T13:14:18.164Z","pid":1732,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1126gitlab # [ 92.468283] bundle[1732]: {"timestamp":"2026-08-13T13:14:18.164Z","pid":1732,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1127gitlab # [ 92.468913] bundle[1732]: {"timestamp":"2026-08-13T13:14:18.164Z","pid":1732,"message":"* Min threads: 0"}1128gitlab # [ 92.475773] bundle[1732]: {"timestamp":"2026-08-13T13:14:18.173Z","pid":1732,"message":"* Max threads: 4"}1129gitlab # [ 92.476561] bundle[1732]: {"timestamp":"2026-08-13T13:14:18.173Z","pid":1732,"message":"* Environment: production"}1130gitlab # [ 92.478944] bundle[1732]: {"timestamp":"2026-08-13T13:14:18.176Z","pid":1732,"message":"* Master PID: 1732"}1131gitlab # [ 92.479691] bundle[1732]: {"timestamp":"2026-08-13T13:14:18.177Z","pid":1732,"message":"* Workers: 2"}1132gitlab # [ 92.482060] bundle[1732]: {"timestamp":"2026-08-13T13:14:18.180Z","pid":1732,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1133gitlab # [ 92.482597] bundle[1732]: {"timestamp":"2026-08-13T13:14:18.180Z","pid":1732,"message":"* Preloading application"}1134gitlab # [ 97.752542] gitlab-workhorse[822]: time="2026-08-13T13:14:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1135gitlab # [ 107.752918] gitlab-workhorse[822]: time="2026-08-13T13:14:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1136gitlab # [ 117.762737] gitlab-workhorse[822]: time="2026-08-13T13:14:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1137gitlab # [ 120.651225] bundle[1732]: W, [2026-08-13T13:14:46.348865 #1732] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1138gitlab # [ 123.747132] sidekiq-cluster[1772]: 2026-08-13T13:14:49.444Z pid=1772 tid=wg4 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1772, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433709056}1139gitlab # [ 123.989229] sidekiq-cluster[1772]: W, [2026-08-13T13:14:49.687092 #1772] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1140gitlab # [ 124.039218] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:49.737Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1141gitlab # [ 126.441563] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.139Z","message":"GitLab reliable fetch activated!"}1142gitlab # [ 126.441847] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.139Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1143gitlab # [ 126.479316] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.177Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1144gitlab # [ 126.486692] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.184Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1145gitlab # [ 126.495887] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.193Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1146gitlab # [ 126.499980] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.197Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1147gitlab # [ 126.507150] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.205Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1148gitlab # [ 126.516543] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.214Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1149gitlab # [ 126.522725] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.220Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1150gitlab # [ 126.527830] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.225Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1151gitlab # [ 126.532750] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.230Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1152gitlab # [ 126.538416] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.236Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1153gitlab # [ 126.544335] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.242Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1154gitlab # [ 126.554896] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.252Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1155gitlab # [ 126.561293] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.259Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1156gitlab # [ 126.567215] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.265Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1157gitlab # [ 126.573229] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.271Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1158gitlab # [ 126.579245] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.277Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1159gitlab # [ 126.585662] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.283Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1160gitlab # [ 126.593671] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.291Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1161gitlab # [ 126.602261] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.300Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1162gitlab # [ 126.608501] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.306Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1163gitlab # [ 126.614445] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.312Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1164gitlab # [ 126.619905] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.317Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1165gitlab # [ 126.625286] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.323Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1166gitlab # [ 126.631823] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.329Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1167gitlab # [ 126.639511] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.337Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1168gitlab # [ 126.645499] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.343Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1169gitlab # [ 126.651809] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.349Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1170gitlab # [ 126.657744] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.355Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1171gitlab # [ 126.663882] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.361Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1172gitlab # [ 126.670670] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.368Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1173gitlab # [ 126.678561] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.376Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1174gitlab # [ 126.688689] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.386Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1175gitlab # [ 126.694702] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.392Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1176gitlab # [ 126.700638] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.398Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1177gitlab # [ 126.706323] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.404Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1178gitlab # [ 126.711846] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.409Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1179gitlab # [ 126.716772] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.414Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1180gitlab # [ 126.723427] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.421Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1181gitlab # [ 126.727785] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.425Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1182gitlab # [ 126.732325] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.429Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1183gitlab # [ 126.736842] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.434Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1184gitlab # [ 126.741940] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.439Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1185gitlab # [ 126.746068] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.443Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1186gitlab # [ 126.750582] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.448Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1187gitlab # [ 126.758223] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.456Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1188gitlab # [ 126.766093] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.463Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1189gitlab # [ 126.774034] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.471Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1190gitlab # [ 126.780449] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.478Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1191gitlab # [ 126.787545] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.485Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1192gitlab # [ 126.794426] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.492Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1193gitlab # [ 126.801331] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.499Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1194gitlab # [ 126.809841] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.506Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1195gitlab # [ 126.823833] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.521Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1196gitlab # [ 126.830269] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.528Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1197gitlab # [ 126.835924] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.533Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1198gitlab # [ 126.841745] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.539Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1199gitlab # [ 126.847055] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.545Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1200gitlab # [ 126.854190] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.552Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1201gitlab # [ 126.860310] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.558Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1202gitlab # [ 126.866092] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.564Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1203gitlab # [ 126.871306] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.569Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1204gitlab # [ 126.876165] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.574Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1205gitlab # [ 126.882152] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.580Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1206gitlab # [ 126.889139] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.586Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1207gitlab # [ 126.954469] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.651Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1208gitlab # [ 126.961054] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.659Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1209gitlab # [ 126.966873] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.664Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1210gitlab # [ 126.972607] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.670Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1211gitlab # [ 126.979486] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.677Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1212gitlab # [ 126.985598] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.683Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1213gitlab # [ 126.991786] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.689Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1214gitlab # [ 126.997337] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.695Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1215gitlab # [ 127.002343] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.700Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1216gitlab # [ 127.007938] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.705Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1217gitlab # [ 127.013181] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.711Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1218gitlab # [ 127.019260] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.717Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1219gitlab # [ 127.024905] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.722Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1220gitlab # [ 127.031185] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.729Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1221gitlab # [ 127.039565] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.737Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1222gitlab # [ 127.046670] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.744Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1223gitlab # [ 127.053291] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.751Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1224gitlab # [ 127.060229] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.758Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1225gitlab # [ 127.068246] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.766Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1226gitlab # [ 127.076128] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.773Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1227gitlab # [ 127.085112] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.783Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1228gitlab # [ 127.092397] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.790Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1229gitlab # [ 127.099567] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.797Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1230gitlab # [ 127.106163] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.804Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1231gitlab # [ 127.112615] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.810Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1232gitlab # [ 127.122919] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.820Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1233gitlab # [ 127.129266] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.827Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1234gitlab # [ 127.134872] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.832Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1235gitlab # [ 127.141271] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.839Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1236gitlab # [ 127.147598] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.845Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1237gitlab # [ 127.153815] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.851Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1238gitlab # [ 127.164106] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.862Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1239gitlab # [ 127.170705] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.868Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1240gitlab # [ 127.176926] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.874Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1241gitlab # [ 127.193932] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.891Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1242gitlab # [ 127.201684] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.899Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1243gitlab # [ 127.210186] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.908Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1244gitlab # [ 127.217861] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.915Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1245gitlab # [ 127.224833] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.922Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1246gitlab # [ 127.231703] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.929Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1247gitlab # [ 127.239287] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.937Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1248gitlab # [ 127.248684] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.946Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1249gitlab # [ 127.256199] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.954Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1250gitlab # [ 127.264841] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.962Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1251gitlab # [ 127.272080] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:14:52.969Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1252gitlab # [ 127.767833] gitlab-workhorse[822]: time="2026-08-13T13:14:53Z" level=error correlation_id= duration_ms=4 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1253gitlab # [ 137.768460] gitlab-workhorse[822]: time="2026-08-13T13:15:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1254gitlab # [ 147.769453] gitlab-workhorse[822]: time="2026-08-13T13:15:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1255gitlab # [ 155.094967] postgres[2356]: [2356] ERROR: relation "table_without_models" does not exist1256gitlab # [ 155.096745] postgres[2356]: [2356] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1257gitlab # [ 157.430291] postgres[2379]: [2379] ERROR: relation "table_without_models" does not exist1258gitlab # [ 157.430804] postgres[2379]: [2379] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1259gitlab # [ 157.779352] gitlab-workhorse[822]: time="2026-08-13T13:15:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1260gitlab # [ 158.617526] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:24.315Z","message":"Booted Rails 7.2.3.1 application in production environment"}1261gitlab # [ 158.619993] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:24.317Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1262gitlab # [ 158.620668] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:24.317Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1263gitlab # [ 158.621718] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:24.317Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1264gitlab # [ 158.632105] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:24.328Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1265gitlab # [ 160.457253] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:26.154Z","message":"Cleaning working queues"}1266gitlab # [ 160.461391] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:26.159Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7db5f8bf076502381af56c5c","created_at":"2026-08-13T13:14:13.599Z","trace_propagation_headers":{"sentry-trace":"6db99537b679493e9fa08c331eb1f773-16906e915efb4e77","baggage":"sentry-trace_id=6db99537b679493e9fa08c331eb1f773,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"71620ebfef695e96e46165e9a5c016b0","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-13T13:14:13.611Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7db5f8bf076502381af56c5c: start","job_status":"start","queue_duration_s":72.547104,"scheduling_latency_s":72.547163}1267gitlab # [ 160.644592] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:26.341Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7db5f8bf076502381af56c5c","created_at":"2026-08-13T13:14:13.599Z","trace_propagation_headers":{"sentry-trace":"6db99537b679493e9fa08c331eb1f773-16906e915efb4e77","baggage":"sentry-trace_id=6db99537b679493e9fa08c331eb1f773,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"71620ebfef695e96e46165e9a5c016b0","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-13T13:14:13.611Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7db5f8bf076502381af56c5c: done: 0.183177 sec","job_status":"done","queue_duration_s":72.547104,"scheduling_latency_s":72.547163,"redis_calls":29,"redis_duration_s":0.008485,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.005446,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001749,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00129,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08296948300000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.183177,"completed_at":"2026-08-13T13:15:26.341Z","load_balancing_strategy":"primary","db_duration_s":0.03947,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1268gitlab # [ 161.614426] bundle[1732]: {"timestamp":"2026-08-13T13:15:27.312Z","pid":1732,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1269gitlab # [ 161.614697] bundle[1732]: {"timestamp":"2026-08-13T13:15:27.312Z","pid":1732,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1270gitlab # [ 161.615572] bundle[1732]: {"timestamp":"2026-08-13T13:15:27.312Z","pid":1732,"message":"! #\u003cThread:0x00007f6e701773d0 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1271gitlab # [ 161.616536] bundle[1732]: {"timestamp":"2026-08-13T13:15:27.312Z","pid":1732,"message":"! #\u003cThread:0x00007f6e7042ce68 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1272gitlab # [ 161.617401] bundle[1732]: {"timestamp":"2026-08-13T13:15:27.312Z","pid":1732,"message":"Use Ctrl-C to stop"}1273gitlab # [ 161.631634] bundle[1732]: {"timestamp":"2026-08-13T13:15:27.329Z","pid":1732,"message":"Sending status to systemd every 1.0 sec"}1274gitlab # [ 162.006800] bundle[1732]: {"timestamp":"2026-08-13T13:15:27.704Z","pid":1732,"message":"- Worker 0 (PID: 2457) booted in 0.35s, phase: 0"}1275gitlab # [ 162.020248] bundle[1732]: {"timestamp":"2026-08-13T13:15:27.718Z","pid":1732,"message":"- Worker 1 (PID: 2461) booted in 0.35s, phase: 0"}1276gitlab # [ 162.024722] systemd[1]: Started gitlab.service.1277gitlab # [ 162.025940] systemd[1]: Reached target Common target for all GitLab services..1278gitlab # [ 162.028778] systemd[1]: Starting setup-gitlab.service...1279gitlab # [ 162.055996] setup-gitlab-start[2485]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1280gitlab # [ 164.927185] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:15:30 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 28411281gitlab # [ 164.931842] setup-gitlab-start[2485]: + TOKEN=nixbot-test-token-of-20-chars1282gitlab # [ 164.932768] setup-gitlab-start[2485]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1283gitlab # [ 164.946404] runuser[2507]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1284gitlab # [ 165.426169] setup-gitlab-start[2508]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1285gitlab # [ 165.426442] setup-gitlab-start[2508]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1286gitlab # [ 165.428366] setup-gitlab-start[2508]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1287gitlab # [ 166.161243] setup-gitlab-start[2508]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1288gitlab # [ 166.161785] setup-gitlab-start[2508]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1289gitlab # [ 166.163882] setup-gitlab-start[2508]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1290gitlab # [ 174.264958] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:39.962Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"399e738b5f12b9fca4df1736","created_at":"2026-08-13T13:15:39.931Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c2d827d256adfaf6ce2f0f4f6421891","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:39.959Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-399e738b5f12b9fca4df1736: start","job_status":"start","queue_duration_s":0.002181,"scheduling_latency_s":0.002228}1291gitlab # [ 174.784067] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:40.481Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"399e738b5f12b9fca4df1736","created_at":"2026-08-13T13:15:39.931Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c2d827d256adfaf6ce2f0f4f6421891","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:39.959Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-399e738b5f12b9fca4df1736: done: 0.519285 sec","job_status":"done","queue_duration_s":0.002181,"scheduling_latency_s":0.002228,"redis_calls":14,"redis_duration_s":0.019544,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00357,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004237,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.011737,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.083,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.081,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.226047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.010489322,"exclusive_lock_hold_duration_s":0.425949667,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.519285,"completed_at":"2026-08-13T13:15:40.481Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.243045,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 174.835309] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:40.488Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a45c00a037519e7ead0d9d38","created_at":"2026-08-13T13:15:39.972Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"87c7796c8c1997a5400da76c0ebe4a7f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-13T13:15:39.989Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a45c00a037519e7ead0d9d38: start","job_status":"start","queue_duration_s":0.499012,"scheduling_latency_s":0.499044}1293gitlab # [ 174.852120] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:40.520Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1294gitlab # [ 174.857075] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:40.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a45c00a037519e7ead0d9d38","created_at":"2026-08-13T13:15:39.972Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"87c7796c8c1997a5400da76c0ebe4a7f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-13T13:15:39.989Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a45c00a037519e7ead0d9d38: done: 0.046519 sec","job_status":"done","queue_duration_s":0.499012,"scheduling_latency_s":0.499044,"redis_calls":10,"redis_duration_s":0.016805,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.009532,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005321,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001952,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001522819,"duration_s":0.046519,"completed_at":"2026-08-13T13:15:40.534Z","load_balancing_strategy":"primary","db_duration_s":0.000548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295gitlab # [ 174.907348] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:40.548Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"20165623bc31ff0a6c06d485","created_at":"2026-08-13T13:15:39.998Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80ba93dac472b1e65e369fde496dacbc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.005Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-20165623bc31ff0a6c06d485: start","job_status":"start","queue_duration_s":0.542945,"scheduling_latency_s":0.542976}1296gitlab # [ 174.925373] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:40.566Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1297gitlab # [ 174.930379] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:40.585Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"20165623bc31ff0a6c06d485","created_at":"2026-08-13T13:15:39.998Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80ba93dac472b1e65e369fde496dacbc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.005Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-20165623bc31ff0a6c06d485: done: 0.036407 sec","job_status":"done","queue_duration_s":0.542945,"scheduling_latency_s":0.542976,"redis_calls":10,"redis_duration_s":0.008055,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002145,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004449,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001461,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001895492,"duration_s":0.036407,"completed_at":"2026-08-13T13:15:40.585Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001031,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 174.931343] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:40.590Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"301b9fe9a7a500a8fcb98a9d","created_at":"2026-08-13T13:15:40.013Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d58b543a12c63d4fb67ad91fd612818","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.023Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-301b9fe9a7a500a8fcb98a9d: start","job_status":"start","queue_duration_s":0.56709,"scheduling_latency_s":0.567113}1299gitlab # [ 175.045929] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:40.743Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"301b9fe9a7a500a8fcb98a9d","created_at":"2026-08-13T13:15:40.013Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d58b543a12c63d4fb67ad91fd612818","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.023Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-301b9fe9a7a500a8fcb98a9d: done: 0.152545 sec","job_status":"done","queue_duration_s":0.56709,"scheduling_latency_s":0.567113,"redis_calls":10,"redis_duration_s":0.086041,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0727,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010865,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002476,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001362464,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.152545,"completed_at":"2026-08-13T13:15:40.743Z","load_balancing_strategy":"primary","db_duration_s":0.024915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 175.100600] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:40.798Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"9cef71f242b0133fc1f5ec01","created_at":"2026-08-13T13:15:40.040Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80f91883bab88574c01ca2f9e9a4a12c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.068Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-9cef71f242b0133fc1f5ec01: start","job_status":"start","queue_duration_s":0.729695,"scheduling_latency_s":0.729729}1301gitlab # [ 175.150383] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:40.847Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"9cef71f242b0133fc1f5ec01","created_at":"2026-08-13T13:15:40.040Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80f91883bab88574c01ca2f9e9a4a12c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.068Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-9cef71f242b0133fc1f5ec01: done: 0.049644 sec","job_status":"done","queue_duration_s":0.729695,"scheduling_latency_s":0.729729,"redis_calls":19,"redis_duration_s":0.004491,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000871,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000486,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002339,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000795,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000509282,"duration_s":0.049644,"completed_at":"2026-08-13T13:15:40.847Z","load_balancing_strategy":"primary","db_duration_s":0.001918,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 175.204811] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:40.902Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d850167182c1de7ad790c705","created_at":"2026-08-13T13:15:40.072Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e93709831b48df42686ea124634243df","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.079Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d850167182c1de7ad790c705: start","job_status":"start","queue_duration_s":0.822248,"scheduling_latency_s":0.822297}1303gitlab # [ 175.241922] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:40.939Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d850167182c1de7ad790c705","created_at":"2026-08-13T13:15:40.072Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e93709831b48df42686ea124634243df","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.079Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d850167182c1de7ad790c705: done: 0.037234 sec","job_status":"done","queue_duration_s":0.822248,"scheduling_latency_s":0.822297,"redis_calls":12,"redis_duration_s":0.003584,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000591,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001523,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000858209,"exclusive_lock_hold_duration_s":0.010541564,"duration_s":0.037234,"completed_at":"2026-08-13T13:15:40.939Z","load_balancing_strategy":"primary","db_duration_s":0.00542,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 175.296059] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:40.993Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"839d879abce830c25b205be7","created_at":"2026-08-13T13:15:40.090Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cc67db3fd9195d343db5c18cb19f2c47","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.104Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-839d879abce830c25b205be7: start","job_status":"start","queue_duration_s":0.888869,"scheduling_latency_s":0.888902}1305gitlab # [ 175.326913] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:41.024Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1306gitlab # [ 175.339263] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:41.036Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"839d879abce830c25b205be7","created_at":"2026-08-13T13:15:40.090Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cc67db3fd9195d343db5c18cb19f2c47","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.104Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-839d879abce830c25b205be7: done: 0.043491 sec","job_status":"done","queue_duration_s":0.888869,"scheduling_latency_s":0.888902,"redis_calls":10,"redis_duration_s":0.005113,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000548,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000565,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000463467,"duration_s":0.043491,"completed_at":"2026-08-13T13:15:41.036Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 175.397684] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:41.095Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMigrateExternalDiffsWorker","jid":"1667a579bbea5bca3f396ead","created_at":"2026-08-13T13:15:40.119Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"631553c2ad94105e1d666451ac3ff974","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1f56d9ee4ddd7fd390ae51dd41358b9c806acf2491cad4e28b1956ebf69a9b52","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.131Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMigrateExternalDiffsWorker JID-1667a579bbea5bca3f396ead: start","job_status":"start","queue_duration_s":0.963924,"scheduling_latency_s":0.964004}1308gitlab # [ 175.417892] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:41.115Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMigrateExternalDiffsWorker","jid":"1667a579bbea5bca3f396ead","created_at":"2026-08-13T13:15:40.119Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"631553c2ad94105e1d666451ac3ff974","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1f56d9ee4ddd7fd390ae51dd41358b9c806acf2491cad4e28b1956ebf69a9b52","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.131Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMigrateExternalDiffsWorker JID-1667a579bbea5bca3f396ead: done: 0.020489 sec","job_status":"done","queue_duration_s":0.963924,"scheduling_latency_s":0.964004,"redis_calls":12,"redis_duration_s":0.0027429999999999998,"redis_read_bytes":11,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000456,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":311,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001278,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":533,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000630807,"exclusive_lock_hold_duration_s":0.00047631700000000003,"duration_s":0.020489,"completed_at":"2026-08-13T13:15:41.115Z","load_balancing_strategy":"primary","db_duration_s":0.000562,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 175.472643] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:41.170Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ccf40835e672c6088adf1e1e","created_at":"2026-08-13T13:15:40.142Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ccb88e9b5603a0d66e0180e71c6cd423","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.150Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ccf40835e672c6088adf1e1e: start","job_status":"start","queue_duration_s":1.019615,"scheduling_latency_s":1.019652}1310gitlab # [ 175.504805] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:41.202Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1311gitlab # [ 175.518526] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:41.216Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ccf40835e672c6088adf1e1e","created_at":"2026-08-13T13:15:40.142Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ccb88e9b5603a0d66e0180e71c6cd423","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.150Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ccf40835e672c6088adf1e1e: done: 0.045867 sec","job_status":"done","queue_duration_s":1.019615,"scheduling_latency_s":1.019652,"redis_calls":10,"redis_duration_s":0.0075840000000000005,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000493,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006496,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000595,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000433575,"duration_s":0.045867,"completed_at":"2026-08-13T13:15:41.215Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 175.570207] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:41.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"bde86909c7974e7a822dd288","created_at":"2026-08-13T13:15:40.172Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb9a9e4c02dafdd945e756884e31a142","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.182Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-bde86909c7974e7a822dd288: start","job_status":"start","queue_duration_s":1.084934,"scheduling_latency_s":1.084996}1313gitlab # [ 175.600572] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:41.298Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"bde86909c7974e7a822dd288","created_at":"2026-08-13T13:15:40.172Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb9a9e4c02dafdd945e756884e31a142","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.182Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-bde86909c7974e7a822dd288: done: 0.030356 sec","job_status":"done","queue_duration_s":1.084934,"scheduling_latency_s":1.084996,"redis_calls":10,"redis_duration_s":0.003048,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00054,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001748,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00076,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000514591,"duration_s":0.030356,"completed_at":"2026-08-13T13:15:41.298Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002549,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 175.656213] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:41.353Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"f30ef234f13588e1cd5c56ab","created_at":"2026-08-13T13:15:40.194Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ad5c0c26e59094c9f97af2640562422","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.208Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-f30ef234f13588e1cd5c56ab: start","job_status":"start","queue_duration_s":1.145818,"scheduling_latency_s":1.145852}1315gitlab # [ 175.689350] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:41.386Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"f30ef234f13588e1cd5c56ab","created_at":"2026-08-13T13:15:40.194Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ad5c0c26e59094c9f97af2640562422","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.208Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-f30ef234f13588e1cd5c56ab: done: 0.033015 sec","job_status":"done","queue_duration_s":1.145818,"scheduling_latency_s":1.145852,"redis_calls":10,"redis_duration_s":0.002353,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000547,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001389,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000417,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000345575,"duration_s":0.033015,"completed_at":"2026-08-13T13:15:41.386Z","load_balancing_strategy":"primary","db_duration_s":0.005206,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 175.739554] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:41.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"122fbe8889a1fddb06ec1c72","created_at":"2026-08-13T13:15:40.219Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47e8ade5b5e43b9555e23a75b54a5801","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.232Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-122fbe8889a1fddb06ec1c72: start","job_status":"start","queue_duration_s":1.204717,"scheduling_latency_s":1.204751}1317gitlab # [ 175.787298] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:41.484Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"122fbe8889a1fddb06ec1c72","created_at":"2026-08-13T13:15:40.219Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47e8ade5b5e43b9555e23a75b54a5801","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.232Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-122fbe8889a1fddb06ec1c72: done: 0.047509 sec","job_status":"done","queue_duration_s":1.204717,"scheduling_latency_s":1.204751,"redis_calls":12,"redis_duration_s":0.003311,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000522,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001423,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001366,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000562083,"exclusive_lock_hold_duration_s":0.016856612,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.047509,"completed_at":"2026-08-13T13:15:41.484Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 175.842418] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:41.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"236354587d35afad4a6277d8","created_at":"2026-08-13T13:15:40.252Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76d1575914cfebf065778dd1bdc23722","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.262Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-236354587d35afad4a6277d8: start","job_status":"start","queue_duration_s":1.277351,"scheduling_latency_s":1.27739}1319gitlab # [ 176.294385] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:41.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"236354587d35afad4a6277d8","created_at":"2026-08-13T13:15:40.252Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76d1575914cfebf065778dd1bdc23722","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.262Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-236354587d35afad4a6277d8: done: 0.451973 sec","job_status":"done","queue_duration_s":1.277351,"scheduling_latency_s":1.27739,"redis_calls":565,"redis_duration_s":0.127644,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000753,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001692,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.125199,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.360503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000456482,"duration_s":0.451973,"completed_at":"2026-08-13T13:15:41.991Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000612,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 176.351834] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.049Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"060352a51372b76479f47b4f","created_at":"2026-08-13T13:15:40.276Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dafe6d8fd3f1d11140c23e58c69f25fa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.288Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-060352a51372b76479f47b4f: start","job_status":"start","queue_duration_s":1.760437,"scheduling_latency_s":1.760479}1321gitlab # [ 176.383601] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.080Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"060352a51372b76479f47b4f","created_at":"2026-08-13T13:15:40.276Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dafe6d8fd3f1d11140c23e58c69f25fa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.288Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-060352a51372b76479f47b4f: done: 0.031862 sec","job_status":"done","queue_duration_s":1.760437,"scheduling_latency_s":1.760479,"redis_calls":12,"redis_duration_s":0.003086,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001025,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001539,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000522,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000460952,"duration_s":0.031862,"completed_at":"2026-08-13T13:15:42.080Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001033,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 176.441143] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.138Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"341413393547fb500d42627e","created_at":"2026-08-13T13:15:40.301Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"854a1036c1e438c9ae5a6d9867eeeebc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-13T13:15:40.314Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-341413393547fb500d42627e: start","job_status":"start","queue_duration_s":1.824259,"scheduling_latency_s":1.824292}1323gitlab # [ 176.466645] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.164Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1324gitlab # [ 176.473979] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.171Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"341413393547fb500d42627e","created_at":"2026-08-13T13:15:40.301Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"854a1036c1e438c9ae5a6d9867eeeebc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-13T13:15:40.314Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-341413393547fb500d42627e: done: 0.032886 sec","job_status":"done","queue_duration_s":1.824259,"scheduling_latency_s":1.824292,"redis_calls":10,"redis_duration_s":0.002122,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0005,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001231,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000391,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000362057,"duration_s":0.032886,"completed_at":"2026-08-13T13:15:42.171Z","load_balancing_strategy":"primary","db_duration_s":0.012041,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 176.523739] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.221Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"8888919aa9ef6694d5473e23","created_at":"2026-08-13T13:15:40.333Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9296941b42937efb64a4ff903f904724","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.343Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-8888919aa9ef6694d5473e23: start","job_status":"start","queue_duration_s":1.877797,"scheduling_latency_s":1.877839}1326gitlab # [ 176.588074] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.283Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"8888919aa9ef6694d5473e23","created_at":"2026-08-13T13:15:40.333Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9296941b42937efb64a4ff903f904724","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.343Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-8888919aa9ef6694d5473e23: done: 0.062138 sec","job_status":"done","queue_duration_s":1.877797,"scheduling_latency_s":1.877839,"redis_calls":12,"redis_duration_s":0.003689,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000468,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002035,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000595886,"exclusive_lock_hold_duration_s":0.012215519,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.062138,"completed_at":"2026-08-13T13:15:42.283Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014423,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 176.645322] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.343Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"0fa80dba00262f8dc4a7829d","created_at":"2026-08-13T13:15:40.356Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a8e43203afa763fbadfb36e94fbbf3b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.372Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-0fa80dba00262f8dc4a7829d: start","job_status":"start","queue_duration_s":1.970643,"scheduling_latency_s":1.970677}1328gitlab # [ 176.693694] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.391Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"0fa80dba00262f8dc4a7829d","created_at":"2026-08-13T13:15:40.356Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a8e43203afa763fbadfb36e94fbbf3b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.372Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-0fa80dba00262f8dc4a7829d: done: 0.048057 sec","job_status":"done","queue_duration_s":1.970643,"scheduling_latency_s":1.970677,"redis_calls":17,"redis_duration_s":0.004278,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001789,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001493,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000273,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000723,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000400051,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.048057,"completed_at":"2026-08-13T13:15:42.390Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002215,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 176.749798] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.445Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"407d3067baef7a4a7ed711c8","created_at":"2026-08-13T13:15:40.407Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1405608c5baa31f93d71bd902bff4cf3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.417Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-407d3067baef7a4a7ed711c8: start","job_status":"start","queue_duration_s":2.027778,"scheduling_latency_s":2.02782}1330gitlab # [ 176.782689] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.480Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1331gitlab # [ 176.794087] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.491Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"407d3067baef7a4a7ed711c8","created_at":"2026-08-13T13:15:40.407Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1405608c5baa31f93d71bd902bff4cf3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.417Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-407d3067baef7a4a7ed711c8: done: 0.045886 sec","job_status":"done","queue_duration_s":2.027778,"scheduling_latency_s":2.02782,"redis_calls":10,"redis_duration_s":0.003226,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000536,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002102,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000588,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000513194,"duration_s":0.045886,"completed_at":"2026-08-13T13:15:42.491Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000596,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 176.843967] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.541Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"ff8a749915f3fa3bb3e78811","created_at":"2026-08-13T13:15:40.431Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25e0b8b0de4947971a12b07e9034b232","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.447Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-ff8a749915f3fa3bb3e78811: start","job_status":"start","queue_duration_s":2.094163,"scheduling_latency_s":2.094197}1333gitlab # [ 176.870680] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.568Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"ff8a749915f3fa3bb3e78811","created_at":"2026-08-13T13:15:40.431Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25e0b8b0de4947971a12b07e9034b232","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.447Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-ff8a749915f3fa3bb3e78811: done: 0.026794 sec","job_status":"done","queue_duration_s":2.094163,"scheduling_latency_s":2.094197,"redis_calls":10,"redis_duration_s":0.0021190000000000002,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000388,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001299,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000432,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000461232,"duration_s":0.026794,"completed_at":"2026-08-13T13:15:42.568Z","load_balancing_strategy":"primary","db_duration_s":0.003039,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 176.923476] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.621Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"444c99b35fc87775bf2617e2","created_at":"2026-08-13T13:15:40.463Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e1c657c44191adbd57cc67e9d7dd753","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.477Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-444c99b35fc87775bf2617e2: start","job_status":"start","queue_duration_s":2.143424,"scheduling_latency_s":2.143502}1335gitlab # [ 176.966324] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.663Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"444c99b35fc87775bf2617e2","created_at":"2026-08-13T13:15:40.463Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e1c657c44191adbd57cc67e9d7dd753","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.477Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-444c99b35fc87775bf2617e2: done: 0.042688 sec","job_status":"done","queue_duration_s":2.143424,"scheduling_latency_s":2.143502,"redis_calls":13,"redis_duration_s":0.0038900000000000002,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000574,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001997,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001319,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.011386364000000001,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.042688,"completed_at":"2026-08-13T13:15:42.663Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004345,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1336gitlab # [ 177.019208] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.716Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e860d2bd1df0df8d476e5757","created_at":"2026-08-13T13:15:40.487Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43303741c1fc04fb7f86f51ec419a46c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.495Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e860d2bd1df0df8d476e5757: start","job_status":"start","queue_duration_s":2.221419,"scheduling_latency_s":2.221451}1337gitlab # [ 177.043149] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.740Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e860d2bd1df0df8d476e5757","created_at":"2026-08-13T13:15:40.487Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43303741c1fc04fb7f86f51ec419a46c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.495Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e860d2bd1df0df8d476e5757: done: 0.023603 sec","job_status":"done","queue_duration_s":2.221419,"scheduling_latency_s":2.221451,"redis_calls":12,"redis_duration_s":0.002609,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000428,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001231,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000558731,"exclusive_lock_hold_duration_s":0.002640001,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.023603,"completed_at":"2026-08-13T13:15:42.740Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001447,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 177.101864] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.799Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"44853ad6fe2c6e71e454bf19","created_at":"2026-08-13T13:15:40.517Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0de0279a4abb8da44587540f3966160","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T13:15:40.528Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-44853ad6fe2c6e71e454bf19: start","job_status":"start","queue_duration_s":2.271255,"scheduling_latency_s":2.27129}1339gitlab # [ 177.140817] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"44853ad6fe2c6e71e454bf19","created_at":"2026-08-13T13:15:40.517Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0de0279a4abb8da44587540f3966160","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T13:15:40.528Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-44853ad6fe2c6e71e454bf19: done: 0.038951 sec","job_status":"done","queue_duration_s":2.271255,"scheduling_latency_s":2.27129,"redis_calls":10,"redis_duration_s":0.008819,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006762,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001507,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00055,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000443911,"duration_s":0.038951,"completed_at":"2026-08-13T13:15:42.838Z","load_balancing_strategy":"primary","db_duration_s":0.003996,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 177.198703] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.896Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"8dad624ed6edbde6b7fa1761","created_at":"2026-08-13T13:15:40.551Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5c29a7cbb023e431fdc1fb23014ab24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.565Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-8dad624ed6edbde6b7fa1761: start","job_status":"start","queue_duration_s":2.331178,"scheduling_latency_s":2.331213}1341gitlab # [ 177.227935] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.925Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"8dad624ed6edbde6b7fa1761","created_at":"2026-08-13T13:15:40.551Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5c29a7cbb023e431fdc1fb23014ab24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.565Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-8dad624ed6edbde6b7fa1761: done: 0.029243 sec","job_status":"done","queue_duration_s":2.331178,"scheduling_latency_s":2.331213,"redis_calls":11,"redis_duration_s":0.002715,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001517,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000716,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000360381,"duration_s":0.029243,"completed_at":"2026-08-13T13:15:42.925Z","load_balancing_strategy":"primary","db_duration_s":0.002627,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 177.280992] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:42.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::StuckProjectImportJobsWorker","jid":"a9e80eb9abe78e3553dc147b","created_at":"2026-08-13T13:15:40.573Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"666de0102722636ea1fff4a7894bfe7c","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:65d1a1bda9b2a0115065de4f20868193e50a174305a7166fa20fbc82759e43e4","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.586Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::StuckProjectImportJobsWorker JID-a9e80eb9abe78e3553dc147b: start","job_status":"start","queue_duration_s":2.392017,"scheduling_latency_s":2.392057}1343gitlab # [ 177.330090] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.027Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::StuckProjectImportJobsWorker","jid":"a9e80eb9abe78e3553dc147b","created_at":"2026-08-13T13:15:40.573Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"666de0102722636ea1fff4a7894bfe7c","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:65d1a1bda9b2a0115065de4f20868193e50a174305a7166fa20fbc82759e43e4","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.586Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::StuckProjectImportJobsWorker JID-a9e80eb9abe78e3553dc147b: done: 0.049146 sec","job_status":"done","queue_duration_s":2.392017,"scheduling_latency_s":2.392057,"redis_calls":10,"redis_duration_s":0.005419,"redis_read_bytes":9,"redis_write_bytes":1173,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001318,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003252,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000849,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":236,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000329651,"duration_s":0.049146,"completed_at":"2026-08-13T13:15:43.027Z","load_balancing_strategy":"primary","db_duration_s":0.003216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 177.382363] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.079Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"403d62e33c9a9cdc885a6c00","created_at":"2026-08-13T13:15:40.590Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e234892ed96cbd893648daaa699f689","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.598Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-403d62e33c9a9cdc885a6c00: start","job_status":"start","queue_duration_s":2.480447,"scheduling_latency_s":2.480483}1345gitlab # [ 177.422691] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.120Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"403d62e33c9a9cdc885a6c00","created_at":"2026-08-13T13:15:40.590Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e234892ed96cbd893648daaa699f689","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.598Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-403d62e33c9a9cdc885a6c00: done: 0.040937 sec","job_status":"done","queue_duration_s":2.480447,"scheduling_latency_s":2.480483,"redis_calls":10,"redis_duration_s":0.002153,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000461,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001201,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000358146,"duration_s":0.040937,"completed_at":"2026-08-13T13:15:43.120Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002951,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 177.476358] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.173Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"cc9d708ed958122a3b6dcf6d","created_at":"2026-08-13T13:15:40.602Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"030a9bdae7a483d6381fe2cc3b53e434","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.615Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-cc9d708ed958122a3b6dcf6d: start","job_status":"start","queue_duration_s":2.55828,"scheduling_latency_s":2.558316}1347gitlab # [ 177.498787] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.196Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"cc9d708ed958122a3b6dcf6d","created_at":"2026-08-13T13:15:40.602Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"030a9bdae7a483d6381fe2cc3b53e434","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.615Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-cc9d708ed958122a3b6dcf6d: done: 0.022548 sec","job_status":"done","queue_duration_s":2.55828,"scheduling_latency_s":2.558316,"redis_calls":11,"redis_duration_s":0.00235,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00036,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001441,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000549,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000555378,"duration_s":0.022548,"completed_at":"2026-08-13T13:15:43.196Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00064,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 177.549589] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.247Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"891399f3df46fda6ec15a4d5","created_at":"2026-08-13T13:15:40.622Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e8a709b68198cbedef12d0723135da4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.705Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-891399f3df46fda6ec15a4d5: start","job_status":"start","queue_duration_s":2.541874,"scheduling_latency_s":2.541907}1349gitlab # [ 177.589433] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.287Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"891399f3df46fda6ec15a4d5","created_at":"2026-08-13T13:15:40.622Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e8a709b68198cbedef12d0723135da4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.705Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-891399f3df46fda6ec15a4d5: done: 0.039806 sec","job_status":"done","queue_duration_s":2.541874,"scheduling_latency_s":2.541907,"redis_calls":10,"redis_duration_s":0.002631,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00083,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001383,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000360661,"duration_s":0.039806,"completed_at":"2026-08-13T13:15:43.287Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000598,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 177.591492] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.289Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9885baaeae8e57b88d80f102","created_at":"2026-08-13T13:15:40.731Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.745Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9885baaeae8e57b88d80f102: start","job_status":"start","queue_duration_s":2.543608,"scheduling_latency_s":2.543627}1351gitlab # [ 177.731321] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.428Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9885baaeae8e57b88d80f102","created_at":"2026-08-13T13:15:40.731Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.745Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9885baaeae8e57b88d80f102: done: 0.139376 sec","job_status":"done","queue_duration_s":2.543608,"scheduling_latency_s":2.543627,"redis_calls":71,"redis_duration_s":0.023195,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.00246,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000743,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.019202,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00079,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.113177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000396419,"duration_s":0.139376,"completed_at":"2026-08-13T13:15:43.428Z","load_balancing_strategy":"primary","db_duration_s":0.002442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 177.733678] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.431Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"554f3035155b6e8d9cb3a5cd","created_at":"2026-08-13T13:15:40.825Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-def0db285a864cf7","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"80f91883bab88574c01ca2f9e9a4a12c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.838Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-554f3035155b6e8d9cb3a5cd: start","job_status":"start","queue_duration_s":2.592923,"scheduling_latency_s":2.592947}1353gitlab # [ 177.754610] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.452Z","message":"No existing merge request to be cleaned up."}1354gitlab # [ 177.773235] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.470Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"554f3035155b6e8d9cb3a5cd","created_at":"2026-08-13T13:15:40.825Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-def0db285a864cf7","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"80f91883bab88574c01ca2f9e9a4a12c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.838Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-554f3035155b6e8d9cb3a5cd: done: 0.039119 sec","job_status":"done","queue_duration_s":2.592923,"scheduling_latency_s":2.592947,"redis_calls":13,"redis_duration_s":0.0069830000000000005,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000604,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003765,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000407594,"duration_s":0.039119,"completed_at":"2026-08-13T13:15:43.470Z","load_balancing_strategy":"primary","db_duration_s":0.004885,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 177.798079] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.477Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b85b484bbd9969b02be64e18","created_at":"2026-08-13T13:15:40.825Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-def0db285a864cf7","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"80f91883bab88574c01ca2f9e9a4a12c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.838Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b85b484bbd9969b02be64e18: start","job_status":"start","queue_duration_s":2.638959,"scheduling_latency_s":2.638995}1356gitlab # [ 177.852901] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.496Z","message":"No existing merge request to be cleaned up."}1357gitlab # [ 177.853834] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.507Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b85b484bbd9969b02be64e18","created_at":"2026-08-13T13:15:40.825Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-def0db285a864cf7","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"80f91883bab88574c01ca2f9e9a4a12c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.838Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b85b484bbd9969b02be64e18: done: 0.03016 sec","job_status":"done","queue_duration_s":2.638959,"scheduling_latency_s":2.638995,"redis_calls":10,"redis_duration_s":0.007377,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003763,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03016,"completed_at":"2026-08-13T13:15:43.507Z","load_balancing_strategy":"primary","db_duration_s":0.007196,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 177.862849] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.509Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"19c515bcd6da472b81d8d75d","created_at":"2026-08-13T13:15:40.825Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-def0db285a864cf7","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"80f91883bab88574c01ca2f9e9a4a12c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.838Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-19c515bcd6da472b81d8d75d: start","job_status":"start","queue_duration_s":2.670758,"scheduling_latency_s":2.67079}1359gitlab # [ 177.920913] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.522Z","message":"No existing merge request to be cleaned up."}1360gitlab # [ 177.922072] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.531Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"19c515bcd6da472b81d8d75d","created_at":"2026-08-13T13:15:40.825Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-def0db285a864cf7","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"80f91883bab88574c01ca2f9e9a4a12c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.838Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-19c515bcd6da472b81d8d75d: done: 0.022448 sec","job_status":"done","queue_duration_s":2.670758,"scheduling_latency_s":2.67079,"redis_calls":10,"redis_duration_s":0.0025989999999999997,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001545,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022448,"completed_at":"2026-08-13T13:15:43.531Z","load_balancing_strategy":"primary","db_duration_s":0.002341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 177.930365] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.533Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b21ec3806987cbee7f9f32dc","created_at":"2026-08-13T13:15:40.825Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-def0db285a864cf7","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"80f91883bab88574c01ca2f9e9a4a12c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.838Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b21ec3806987cbee7f9f32dc: start","job_status":"start","queue_duration_s":2.694696,"scheduling_latency_s":2.69472}1362gitlab # [ 177.946207] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.548Z","message":"No existing merge request to be cleaned up."}1363gitlab # [ 177.948359] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.561Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b21ec3806987cbee7f9f32dc","created_at":"2026-08-13T13:15:40.825Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-def0db285a864cf7","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"80f91883bab88574c01ca2f9e9a4a12c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:40.838Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b21ec3806987cbee7f9f32dc: done: 0.028137 sec","job_status":"done","queue_duration_s":2.694696,"scheduling_latency_s":2.69472,"redis_calls":10,"redis_duration_s":0.007256,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003043,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004213,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028137,"completed_at":"2026-08-13T13:15:43.561Z","load_balancing_strategy":"primary","db_duration_s":0.004908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 178.016799] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20f3fb5d63f2cdb0f4c17418","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20f3fb5d63f2cdb0f4c17418: start","job_status":"start","queue_duration_s":0.144292,"scheduling_latency_s":0.144317}1365gitlab # [ 178.018208] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20f3fb5d63f2cdb0f4c17418","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20f3fb5d63f2cdb0f4c17418: done: 0.026539 sec","job_status":"done","queue_duration_s":0.144292,"scheduling_latency_s":0.144317,"redis_calls":16,"redis_duration_s":0.004746,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000403,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002888,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000603149,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026539,"completed_at":"2026-08-13T13:15:43.590Z","load_balancing_strategy":"primary","db_duration_s":0.000448,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 178.097493] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e1c676b96369349ea7c39b9","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e1c676b96369349ea7c39b9: start","job_status":"start","queue_duration_s":0.172784,"scheduling_latency_s":0.172813}1367gitlab # [ 178.098660] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e1c676b96369349ea7c39b9","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e1c676b96369349ea7c39b9: done: 0.017867 sec","job_status":"done","queue_duration_s":0.172784,"scheduling_latency_s":0.172813,"redis_calls":13,"redis_duration_s":0.002749,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017867,"completed_at":"2026-08-13T13:15:43.610Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 178.127083] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f427a3e8d3d3c4a2f6a1f9a","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f427a3e8d3d3c4a2f6a1f9a: start","job_status":"start","queue_duration_s":0.19209,"scheduling_latency_s":0.192113}1369gitlab # [ 178.142805] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f427a3e8d3d3c4a2f6a1f9a","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f427a3e8d3d3c4a2f6a1f9a: done: 0.018526 sec","job_status":"done","queue_duration_s":0.19209,"scheduling_latency_s":0.192113,"redis_calls":13,"redis_duration_s":0.004131,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00333,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018526,"completed_at":"2026-08-13T13:15:43.630Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 178.246950] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46241fef9cf9b069d91cf206","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46241fef9cf9b069d91cf206: start","job_status":"start","queue_duration_s":0.212151,"scheduling_latency_s":0.212173}1371gitlab # [ 178.248631] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46241fef9cf9b069d91cf206","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46241fef9cf9b069d91cf206: done: 0.016382 sec","job_status":"done","queue_duration_s":0.212151,"scheduling_latency_s":0.212173,"redis_calls":13,"redis_duration_s":0.00251,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001656,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016382,"completed_at":"2026-08-13T13:15:43.648Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 178.314514] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d55e64e4ec64ddb0a75a7afc","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d55e64e4ec64ddb0a75a7afc: start","job_status":"start","queue_duration_s":0.229779,"scheduling_latency_s":0.2298}1373gitlab # [ 178.315027] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d55e64e4ec64ddb0a75a7afc","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d55e64e4ec64ddb0a75a7afc: done: 0.019978 sec","job_status":"done","queue_duration_s":0.229779,"scheduling_latency_s":0.2298,"redis_calls":13,"redis_duration_s":0.004717,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003225,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019978,"completed_at":"2026-08-13T13:15:43.669Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 178.382521] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb17f4ba2b009abc5f615036","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb17f4ba2b009abc5f615036: start","job_status":"start","queue_duration_s":0.251186,"scheduling_latency_s":0.25121}1375gitlab # [ 178.383855] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb17f4ba2b009abc5f615036","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb17f4ba2b009abc5f615036: done: 0.015721 sec","job_status":"done","queue_duration_s":0.251186,"scheduling_latency_s":0.25121,"redis_calls":13,"redis_duration_s":0.002523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015721,"completed_at":"2026-08-13T13:15:43.687Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 178.454320] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed9b504f2109132de6d9c349","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed9b504f2109132de6d9c349: start","job_status":"start","queue_duration_s":0.268263,"scheduling_latency_s":0.268286}1377gitlab # [ 178.455698] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed9b504f2109132de6d9c349","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed9b504f2109132de6d9c349: done: 0.1287 sec","job_status":"done","queue_duration_s":0.268263,"scheduling_latency_s":0.268286,"redis_calls":13,"redis_duration_s":0.003861,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00106,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002801,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.1287,"completed_at":"2026-08-13T13:15:43.817Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 178.477863] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8b4e80ad865ab57ced94132","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8b4e80ad865ab57ced94132: start","job_status":"start","queue_duration_s":0.399065,"scheduling_latency_s":0.399103}1379gitlab # [ 178.495277] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8b4e80ad865ab57ced94132","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8b4e80ad865ab57ced94132: done: 0.018546 sec","job_status":"done","queue_duration_s":0.399065,"scheduling_latency_s":0.399103,"redis_calls":13,"redis_duration_s":0.0027860000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018546,"completed_at":"2026-08-13T13:15:43.837Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 178.586949] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64e036f58e54be1ea7c024f3","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64e036f58e54be1ea7c024f3: start","job_status":"start","queue_duration_s":0.419105,"scheduling_latency_s":0.419134}1381gitlab # [ 178.588172] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64e036f58e54be1ea7c024f3","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64e036f58e54be1ea7c024f3: done: 0.018669 sec","job_status":"done","queue_duration_s":0.419105,"scheduling_latency_s":0.419134,"redis_calls":13,"redis_duration_s":0.002982,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018669,"completed_at":"2026-08-13T13:15:43.857Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 178.653142] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c285b85649c2556a2905fd7","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c285b85649c2556a2905fd7: start","job_status":"start","queue_duration_s":0.439187,"scheduling_latency_s":0.43921}1383gitlab # [ 178.654123] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c285b85649c2556a2905fd7","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c285b85649c2556a2905fd7: done: 0.020025 sec","job_status":"done","queue_duration_s":0.439187,"scheduling_latency_s":0.43921,"redis_calls":13,"redis_duration_s":0.0029070000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020025,"completed_at":"2026-08-13T13:15:43.879Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 178.736287] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d51c8cae374f5bfa493f4ec","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d51c8cae374f5bfa493f4ec: start","job_status":"start","queue_duration_s":0.461474,"scheduling_latency_s":0.4615}1385gitlab # [ 178.737727] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d51c8cae374f5bfa493f4ec","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d51c8cae374f5bfa493f4ec: done: 0.019965 sec","job_status":"done","queue_duration_s":0.461474,"scheduling_latency_s":0.4615,"redis_calls":13,"redis_duration_s":0.003172,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000981,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002191,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019965,"completed_at":"2026-08-13T13:15:43.901Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 178.765776] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcecb2d758b65a2d76e5d02e","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcecb2d758b65a2d76e5d02e: start","job_status":"start","queue_duration_s":0.483119,"scheduling_latency_s":0.483147}1387gitlab # [ 178.823749] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcecb2d758b65a2d76e5d02e","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcecb2d758b65a2d76e5d02e: done: 0.017631 sec","job_status":"done","queue_duration_s":0.483119,"scheduling_latency_s":0.483147,"redis_calls":13,"redis_duration_s":0.0028659999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001826,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017631,"completed_at":"2026-08-13T13:15:43.920Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 178.825258] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37f59016a71f65718be1ac6a","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37f59016a71f65718be1ac6a: start","job_status":"start","queue_duration_s":0.502117,"scheduling_latency_s":0.50214}1389gitlab # [ 178.885349] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37f59016a71f65718be1ac6a","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37f59016a71f65718be1ac6a: done: 0.014578 sec","job_status":"done","queue_duration_s":0.502117,"scheduling_latency_s":0.50214,"redis_calls":13,"redis_duration_s":0.002532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000838,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001694,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014578,"completed_at":"2026-08-13T13:15:43.936Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 178.886738] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2b33d9980a21d8ccbbc9959","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2b33d9980a21d8ccbbc9959: start","job_status":"start","queue_duration_s":0.517879,"scheduling_latency_s":0.517899}1391gitlab # [ 178.899339] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2b33d9980a21d8ccbbc9959","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2b33d9980a21d8ccbbc9959: done: 0.016269 sec","job_status":"done","queue_duration_s":0.517879,"scheduling_latency_s":0.517899,"redis_calls":13,"redis_duration_s":0.002697,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000729,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016269,"completed_at":"2026-08-13T13:15:43.954Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 178.972984] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:43.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7ad89a9e73710ef291e34ce","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7ad89a9e73710ef291e34ce: start","job_status":"start","queue_duration_s":0.535485,"scheduling_latency_s":0.535507}1393gitlab # [ 178.974114] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7ad89a9e73710ef291e34ce","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7ad89a9e73710ef291e34ce: done: 0.17841 sec","job_status":"done","queue_duration_s":0.535485,"scheduling_latency_s":0.535507,"redis_calls":13,"redis_duration_s":0.162724,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.161866,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.17841,"completed_at":"2026-08-13T13:15:44.134Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 179.031722] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d4cecb6673128ed95ae7a54","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d4cecb6673128ed95ae7a54: start","job_status":"start","queue_duration_s":0.715596,"scheduling_latency_s":0.715619}1395gitlab # [ 179.032224] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d4cecb6673128ed95ae7a54","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d4cecb6673128ed95ae7a54: done: 0.016186 sec","job_status":"done","queue_duration_s":0.715596,"scheduling_latency_s":0.715619,"redis_calls":13,"redis_duration_s":0.002494,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001719,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016186,"completed_at":"2026-08-13T13:15:44.151Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 179.113415] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77f6cb0a6433be5cdcfb134d","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77f6cb0a6433be5cdcfb134d: start","job_status":"start","queue_duration_s":0.733189,"scheduling_latency_s":0.733212}1397gitlab # [ 179.114467] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77f6cb0a6433be5cdcfb134d","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77f6cb0a6433be5cdcfb134d: done: 0.01591 sec","job_status":"done","queue_duration_s":0.733189,"scheduling_latency_s":0.733212,"redis_calls":13,"redis_duration_s":0.002545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001668,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01591,"completed_at":"2026-08-13T13:15:44.169Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 179.140058] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26b2651cac8a199ff4ed27fd","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26b2651cac8a199ff4ed27fd: start","job_status":"start","queue_duration_s":0.750645,"scheduling_latency_s":0.750671}1399gitlab # [ 179.195243] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26b2651cac8a199ff4ed27fd","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26b2651cac8a199ff4ed27fd: done: 0.018397 sec","job_status":"done","queue_duration_s":0.750645,"scheduling_latency_s":0.750671,"redis_calls":13,"redis_duration_s":0.002985,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018397,"completed_at":"2026-08-13T13:15:44.189Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 179.199855] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04770d9b481a6c63171b94d7","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04770d9b481a6c63171b94d7: start","job_status":"start","queue_duration_s":0.770609,"scheduling_latency_s":0.770636}1401gitlab # [ 179.216910] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04770d9b481a6c63171b94d7","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04770d9b481a6c63171b94d7: done: 0.016761 sec","job_status":"done","queue_duration_s":0.770609,"scheduling_latency_s":0.770636,"redis_calls":13,"redis_duration_s":0.002623,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000872,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001751,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016761,"completed_at":"2026-08-13T13:15:44.207Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 179.274207] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a5a5bb0936da952d8f1e144","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a5a5bb0936da952d8f1e144: start","job_status":"start","queue_duration_s":0.788966,"scheduling_latency_s":0.788988}1403gitlab # [ 179.281295] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a5a5bb0936da952d8f1e144","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a5a5bb0936da952d8f1e144: done: 0.015469 sec","job_status":"done","queue_duration_s":0.788966,"scheduling_latency_s":0.788988,"redis_calls":13,"redis_duration_s":0.002532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000784,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001748,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015469,"completed_at":"2026-08-13T13:15:44.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 179.343437] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2860f9fcbd187f0a596b0963","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2860f9fcbd187f0a596b0963: start","job_status":"start","queue_duration_s":0.805816,"scheduling_latency_s":0.805839}1405gitlab # [ 179.344374] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2860f9fcbd187f0a596b0963","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2860f9fcbd187f0a596b0963: done: 0.01639 sec","job_status":"done","queue_duration_s":0.805816,"scheduling_latency_s":0.805839,"redis_calls":13,"redis_duration_s":0.0033880000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001453,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01639,"completed_at":"2026-08-13T13:15:44.242Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 179.409201] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64c643b1bfefce8875bd48d8","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64c643b1bfefce8875bd48d8: start","job_status":"start","queue_duration_s":0.823586,"scheduling_latency_s":0.82361}1407gitlab # [ 179.411355] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64c643b1bfefce8875bd48d8","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64c643b1bfefce8875bd48d8: done: 0.015711 sec","job_status":"done","queue_duration_s":0.823586,"scheduling_latency_s":0.82361,"redis_calls":13,"redis_duration_s":0.002658,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000839,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001819,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015711,"completed_at":"2026-08-13T13:15:44.259Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 179.474387] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fe28766a922c382bd07e8dd","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fe28766a922c382bd07e8dd: start","job_status":"start","queue_duration_s":0.840693,"scheduling_latency_s":0.840717}1409gitlab # [ 179.475476] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fe28766a922c382bd07e8dd","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fe28766a922c382bd07e8dd: done: 0.016389 sec","job_status":"done","queue_duration_s":0.840693,"scheduling_latency_s":0.840717,"redis_calls":13,"redis_duration_s":0.002663,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001867,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016389,"completed_at":"2026-08-13T13:15:44.277Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 179.530091] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0367813c0397b46bd3cd5eb7","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0367813c0397b46bd3cd5eb7: start","job_status":"start","queue_duration_s":0.858822,"scheduling_latency_s":0.858847}1411gitlab # [ 179.531326] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0367813c0397b46bd3cd5eb7","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0367813c0397b46bd3cd5eb7: done: 0.015815 sec","job_status":"done","queue_duration_s":0.858822,"scheduling_latency_s":0.858847,"redis_calls":13,"redis_duration_s":0.00264,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015815,"completed_at":"2026-08-13T13:15:44.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 179.597284] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ac28f3544105699a5663da0","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ac28f3544105699a5663da0: start","job_status":"start","queue_duration_s":0.876003,"scheduling_latency_s":0.876026}1413gitlab # [ 179.598463] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ac28f3544105699a5663da0","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ac28f3544105699a5663da0: done: 0.015587 sec","job_status":"done","queue_duration_s":0.876003,"scheduling_latency_s":0.876026,"redis_calls":13,"redis_duration_s":0.0026030000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000856,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001747,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015587,"completed_at":"2026-08-13T13:15:44.311Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 179.675355] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91ce4b51c71fefa8183fee7a","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91ce4b51c71fefa8183fee7a: start","job_status":"start","queue_duration_s":0.893057,"scheduling_latency_s":0.893081}1415gitlab # [ 179.676350] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91ce4b51c71fefa8183fee7a","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91ce4b51c71fefa8183fee7a: done: 0.017911 sec","job_status":"done","queue_duration_s":0.893057,"scheduling_latency_s":0.893081,"redis_calls":13,"redis_duration_s":0.002718,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001827,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017911,"completed_at":"2026-08-13T13:15:44.331Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 179.738937] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e81010e3c297f88c59b39d4","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e81010e3c297f88c59b39d4: start","job_status":"start","queue_duration_s":0.912494,"scheduling_latency_s":0.912518}1417gitlab # [ 179.739963] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e81010e3c297f88c59b39d4","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e81010e3c297f88c59b39d4: done: 0.015467 sec","job_status":"done","queue_duration_s":0.912494,"scheduling_latency_s":0.912518,"redis_calls":13,"redis_duration_s":0.0025960000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000736,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015467,"completed_at":"2026-08-13T13:15:44.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 179.759105] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91bb32060ebfc10790131b6c","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91bb32060ebfc10790131b6c: start","job_status":"start","queue_duration_s":0.929326,"scheduling_latency_s":0.92935}1419gitlab # [ 179.775713] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91bb32060ebfc10790131b6c","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91bb32060ebfc10790131b6c: done: 0.01554 sec","job_status":"done","queue_duration_s":0.929326,"scheduling_latency_s":0.92935,"redis_calls":13,"redis_duration_s":0.002535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001727,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01554,"completed_at":"2026-08-13T13:15:44.365Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 179.852502] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd4435d38cf96be5b66fd94c","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd4435d38cf96be5b66fd94c: start","job_status":"start","queue_duration_s":0.946245,"scheduling_latency_s":0.946267}1421gitlab # [ 179.853422] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd4435d38cf96be5b66fd94c","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd4435d38cf96be5b66fd94c: done: 0.016306 sec","job_status":"done","queue_duration_s":0.946245,"scheduling_latency_s":0.946267,"redis_calls":13,"redis_duration_s":0.002716,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001838,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016306,"completed_at":"2026-08-13T13:15:44.382Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 179.883062] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4b3c0551e7b8e412523f2db","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4b3c0551e7b8e412523f2db: start","job_status":"start","queue_duration_s":0.964233,"scheduling_latency_s":0.964261}1423gitlab # [ 179.898316] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4b3c0551e7b8e412523f2db","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4b3c0551e7b8e412523f2db: done: 0.017825 sec","job_status":"done","queue_duration_s":0.964233,"scheduling_latency_s":0.964261,"redis_calls":13,"redis_duration_s":0.002882,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017825,"completed_at":"2026-08-13T13:15:44.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 179.959140] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be0275c6740462f9b9d42f21","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be0275c6740462f9b9d42f21: start","job_status":"start","queue_duration_s":0.983386,"scheduling_latency_s":0.983408}1425gitlab # [ 179.960117] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.419Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be0275c6740462f9b9d42f21","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be0275c6740462f9b9d42f21: done: 0.015725 sec","job_status":"done","queue_duration_s":0.983386,"scheduling_latency_s":0.983408,"redis_calls":13,"redis_duration_s":0.002525,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015725,"completed_at":"2026-08-13T13:15:44.419Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 180.003759] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3eb8e2b9523a709378ee4e40","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3eb8e2b9523a709378ee4e40: start","job_status":"start","queue_duration_s":1.000446,"scheduling_latency_s":1.000468}1427gitlab # [ 180.064964] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3eb8e2b9523a709378ee4e40","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3eb8e2b9523a709378ee4e40: done: 0.015513 sec","job_status":"done","queue_duration_s":1.000446,"scheduling_latency_s":1.000468,"redis_calls":13,"redis_duration_s":0.002473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001694,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015513,"completed_at":"2026-08-13T13:15:44.436Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 180.066560] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfb54fe11ff2ac1403b38ac0","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfb54fe11ff2ac1403b38ac0: start","job_status":"start","queue_duration_s":1.017676,"scheduling_latency_s":1.017708}1429gitlab # [ 180.077682] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfb54fe11ff2ac1403b38ac0","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfb54fe11ff2ac1403b38ac0: done: 0.016185 sec","job_status":"done","queue_duration_s":1.017676,"scheduling_latency_s":1.017708,"redis_calls":13,"redis_duration_s":0.002557,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001749,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016185,"completed_at":"2026-08-13T13:15:44.453Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 180.158966] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19d7027fb9d4716d6f71410e","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19d7027fb9d4716d6f71410e: start","job_status":"start","queue_duration_s":1.035166,"scheduling_latency_s":1.035188}1431gitlab # [ 180.159901] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19d7027fb9d4716d6f71410e","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19d7027fb9d4716d6f71410e: done: 0.016987 sec","job_status":"done","queue_duration_s":1.035166,"scheduling_latency_s":1.035188,"redis_calls":13,"redis_duration_s":0.002779,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001857,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016987,"completed_at":"2026-08-13T13:15:44.472Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 180.218690] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18b1cb81a9fb5e77bddab74d","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18b1cb81a9fb5e77bddab74d: start","job_status":"start","queue_duration_s":1.053523,"scheduling_latency_s":1.053554}1433gitlab # [ 180.219854] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18b1cb81a9fb5e77bddab74d","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18b1cb81a9fb5e77bddab74d: done: 0.019256 sec","job_status":"done","queue_duration_s":1.053523,"scheduling_latency_s":1.053554,"redis_calls":13,"redis_duration_s":0.003209,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002275,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019256,"completed_at":"2026-08-13T13:15:44.492Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 180.277763] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a7699ce73868ef4b8a8dc12","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a7699ce73868ef4b8a8dc12: start","job_status":"start","queue_duration_s":1.074252,"scheduling_latency_s":1.074277}1435gitlab # [ 180.278888] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a7699ce73868ef4b8a8dc12","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a7699ce73868ef4b8a8dc12: done: 0.015292 sec","job_status":"done","queue_duration_s":1.074252,"scheduling_latency_s":1.074277,"redis_calls":13,"redis_duration_s":0.002701,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000823,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015292,"completed_at":"2026-08-13T13:15:44.509Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 180.340702] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfe4dded8a841a34db436c2f","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfe4dded8a841a34db436c2f: start","job_status":"start","queue_duration_s":1.091049,"scheduling_latency_s":1.091069}1437gitlab # [ 180.341978] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfe4dded8a841a34db436c2f","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfe4dded8a841a34db436c2f: done: 0.015347 sec","job_status":"done","queue_duration_s":1.091049,"scheduling_latency_s":1.091069,"redis_calls":13,"redis_duration_s":0.002555,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000819,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001736,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015347,"completed_at":"2026-08-13T13:15:44.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 180.364965] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1229c821c8efa6b4ba97928","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1229c821c8efa6b4ba97928: start","job_status":"start","queue_duration_s":1.107756,"scheduling_latency_s":1.107778}1439gitlab # [ 180.380193] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1229c821c8efa6b4ba97928","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1229c821c8efa6b4ba97928: done: 0.015457 sec","job_status":"done","queue_duration_s":1.107756,"scheduling_latency_s":1.107778,"redis_calls":13,"redis_duration_s":0.002578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000844,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001734,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015457,"completed_at":"2026-08-13T13:15:44.543Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 180.427857] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfc7e99d68db35be8c4d7f9e","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfc7e99d68db35be8c4d7f9e: start","job_status":"start","queue_duration_s":1.124885,"scheduling_latency_s":1.124914}1441gitlab # [ 180.442153] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfc7e99d68db35be8c4d7f9e","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfc7e99d68db35be8c4d7f9e: done: 0.019254 sec","job_status":"done","queue_duration_s":1.124885,"scheduling_latency_s":1.124914,"redis_calls":13,"redis_duration_s":0.003098,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019254,"completed_at":"2026-08-13T13:15:44.564Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 180.493512] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee0d46472120a6308ea378ff","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee0d46472120a6308ea378ff: start","job_status":"start","queue_duration_s":1.145868,"scheduling_latency_s":1.145899}1443gitlab # [ 180.502109] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee0d46472120a6308ea378ff","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee0d46472120a6308ea378ff: done: 0.017222 sec","job_status":"done","queue_duration_s":1.145868,"scheduling_latency_s":1.145899,"redis_calls":13,"redis_duration_s":0.002752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001831,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017222,"completed_at":"2026-08-13T13:15:44.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 180.596074] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f92c29985575db469e69112","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f92c29985575db469e69112: start","job_status":"start","queue_duration_s":1.164701,"scheduling_latency_s":1.164725}1445gitlab # [ 180.597108] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f92c29985575db469e69112","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f92c29985575db469e69112: done: 0.015815 sec","job_status":"done","queue_duration_s":1.164701,"scheduling_latency_s":1.164725,"redis_calls":13,"redis_duration_s":0.0024619999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001712,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015815,"completed_at":"2026-08-13T13:15:44.600Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 180.609102] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdebf9bdbc84934abb6199bd","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdebf9bdbc84934abb6199bd: start","job_status":"start","queue_duration_s":1.181838,"scheduling_latency_s":1.181861}1447gitlab # [ 180.665957] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdebf9bdbc84934abb6199bd","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdebf9bdbc84934abb6199bd: done: 0.015475 sec","job_status":"done","queue_duration_s":1.181838,"scheduling_latency_s":1.181861,"redis_calls":13,"redis_duration_s":0.002602,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001851,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015475,"completed_at":"2026-08-13T13:15:44.617Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 180.668565] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b293b17e3b7875c46fd5ae08","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b293b17e3b7875c46fd5ae08: start","job_status":"start","queue_duration_s":1.198672,"scheduling_latency_s":1.198695}1449gitlab # [ 180.721169] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b293b17e3b7875c46fd5ae08","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b293b17e3b7875c46fd5ae08: done: 0.01563 sec","job_status":"done","queue_duration_s":1.198672,"scheduling_latency_s":1.198695,"redis_calls":13,"redis_duration_s":0.00247,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000799,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001671,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01563,"completed_at":"2026-08-13T13:15:44.634Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 180.729209] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06d1e56fc6a446d1dd694913","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06d1e56fc6a446d1dd694913: start","job_status":"start","queue_duration_s":1.215705,"scheduling_latency_s":1.215728}1451gitlab # [ 180.744209] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06d1e56fc6a446d1dd694913","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06d1e56fc6a446d1dd694913: done: 0.016029 sec","job_status":"done","queue_duration_s":1.215705,"scheduling_latency_s":1.215728,"redis_calls":13,"redis_duration_s":0.002613,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001756,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016029,"completed_at":"2026-08-13T13:15:44.651Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 180.817107] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f922beb23682a133630a1506","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f922beb23682a133630a1506: start","job_status":"start","queue_duration_s":1.233225,"scheduling_latency_s":1.233249}1453gitlab # [ 180.818127] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f922beb23682a133630a1506","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f922beb23682a133630a1506: done: 0.015208 sec","job_status":"done","queue_duration_s":1.233225,"scheduling_latency_s":1.233249,"redis_calls":13,"redis_duration_s":0.002618,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001711,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015208,"completed_at":"2026-08-13T13:15:44.668Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 180.896917] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5821db8d7fbdbdfdc1dec625","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5821db8d7fbdbdfdc1dec625: start","job_status":"start","queue_duration_s":1.249815,"scheduling_latency_s":1.249839}1455gitlab # [ 180.897942] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5821db8d7fbdbdfdc1dec625","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5821db8d7fbdbdfdc1dec625: done: 0.015685 sec","job_status":"done","queue_duration_s":1.249815,"scheduling_latency_s":1.249839,"redis_calls":13,"redis_duration_s":0.002777,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015685,"completed_at":"2026-08-13T13:15:44.685Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 180.957706] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8833de662a8bb9ad8842d991","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8833de662a8bb9ad8842d991: start","job_status":"start","queue_duration_s":1.267122,"scheduling_latency_s":1.267145}1457gitlab # [ 180.959140] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8833de662a8bb9ad8842d991","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8833de662a8bb9ad8842d991: done: 0.01548 sec","job_status":"done","queue_duration_s":1.267122,"scheduling_latency_s":1.267145,"redis_calls":13,"redis_duration_s":0.00247,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001663,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01548,"completed_at":"2026-08-13T13:15:44.702Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 181.013345] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd6c6b893c6b6c5c675be8e0","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd6c6b893c6b6c5c675be8e0: start","job_status":"start","queue_duration_s":1.283857,"scheduling_latency_s":1.283881}1459gitlab # [ 181.014408] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd6c6b893c6b6c5c675be8e0","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd6c6b893c6b6c5c675be8e0: done: 0.014976 sec","job_status":"done","queue_duration_s":1.283857,"scheduling_latency_s":1.283881,"redis_calls":13,"redis_duration_s":0.002539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001779,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014976,"completed_at":"2026-08-13T13:15:44.718Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 181.080969] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbe8c3e2b508c740fb8bd6aa","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbe8c3e2b508c740fb8bd6aa: start","job_status":"start","queue_duration_s":1.300087,"scheduling_latency_s":1.300105}1461gitlab # [ 181.081996] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbe8c3e2b508c740fb8bd6aa","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbe8c3e2b508c740fb8bd6aa: done: 0.01553 sec","job_status":"done","queue_duration_s":1.300087,"scheduling_latency_s":1.300105,"redis_calls":13,"redis_duration_s":0.002659,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001758,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01553,"completed_at":"2026-08-13T13:15:44.735Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 181.135724] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21ff23b0e595a1e1459b446d","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21ff23b0e595a1e1459b446d: start","job_status":"start","queue_duration_s":1.316972,"scheduling_latency_s":1.316996}1463gitlab # [ 181.136849] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:15:44.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21ff23b0e595a1e1459b446d","created_at":"2026-08-13T13:15:43.317Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fd034b626c8146c0","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf63d1bf407e14efd0c25af584a8a97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:15:43.420Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21ff23b0e595a1e1459b446d: done: 0.014163 sec","job_status":"done","queue_duration_s":1.316972,"scheduling_latency_s":1.316996,"redis_calls":13,"redis_duration_s":0.002434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001715,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014163,"completed_at":"2026-08-13T13:15:44.751Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 181.441932] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2930216818 wd_nsec: 29302156451465gitlab # [ 196.395270] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.092Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"815bc1e40d8d002673b2b8d9","created_at":"2026-08-13T13:16:02.058Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"267dbedb58906ece8fbc616d15050b26","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.090Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-815bc1e40d8d002673b2b8d9: start","job_status":"start","queue_duration_s":0.002004,"scheduling_latency_s":0.00204}1466gitlab # [ 196.896443] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"815bc1e40d8d002673b2b8d9","created_at":"2026-08-13T13:16:02.058Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"267dbedb58906ece8fbc616d15050b26","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.090Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-815bc1e40d8d002673b2b8d9: done: 0.501645 sec","job_status":"done","queue_duration_s":0.002004,"scheduling_latency_s":0.00204,"redis_calls":11,"redis_duration_s":0.015913,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001875,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009275,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004763,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.118,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.118,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.189441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002947581,"exclusive_lock_hold_duration_s":0.414442897,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.501645,"completed_at":"2026-08-13T13:16:02.593Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.257699,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 196.961977] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.597Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0af94321c97b6968901a5af6","created_at":"2026-08-13T13:16:02.127Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a076fb184ea5af7bdd4a3fee7fc00ec","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-13T13:16:02.131Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0af94321c97b6968901a5af6: start","job_status":"start","queue_duration_s":0.465751,"scheduling_latency_s":0.465773}1468gitlab # [ 196.982945] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.628Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1469gitlab # [ 196.988665] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.633Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0af94321c97b6968901a5af6","created_at":"2026-08-13T13:16:02.127Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a076fb184ea5af7bdd4a3fee7fc00ec","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-13T13:16:02.131Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0af94321c97b6968901a5af6: done: 0.036022 sec","job_status":"done","queue_duration_s":0.465751,"scheduling_latency_s":0.465773,"redis_calls":7,"redis_duration_s":0.007403,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005352,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002051,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036022,"completed_at":"2026-08-13T13:16:02.633Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 197.044681] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.634Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"752dbeea8c41e14ee79bb46c","created_at":"2026-08-13T13:16:02.139Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.145Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-752dbeea8c41e14ee79bb46c: start","job_status":"start","queue_duration_s":0.489157,"scheduling_latency_s":0.489184}1471gitlab # [ 197.045218] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"752dbeea8c41e14ee79bb46c","created_at":"2026-08-13T13:16:02.139Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.145Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-752dbeea8c41e14ee79bb46c: done: 0.102173 sec","job_status":"done","queue_duration_s":0.489157,"scheduling_latency_s":0.489184,"redis_calls":65,"redis_duration_s":0.017904,"redis_read_bytes":114,"redis_write_bytes":41282,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000755,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.000709,"redis_queues_read_bytes":3,"redis_queues_write_bytes":36985,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.015771,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000669,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000487213,"duration_s":0.102173,"completed_at":"2026-08-13T13:16:02.736Z","load_balancing_strategy":"primary","db_duration_s":0.000872,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 197.118849] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.738Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"bb1745a7f4af6a5645bd548f","created_at":"2026-08-13T13:16:02.155Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9a249339c37b216a81bec3030883a29","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.160Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-bb1745a7f4af6a5645bd548f: start","job_status":"start","queue_duration_s":0.578563,"scheduling_latency_s":0.578589}1473gitlab # [ 197.120074] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.749Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1474gitlab # [ 197.121061] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.757Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"bb1745a7f4af6a5645bd548f","created_at":"2026-08-13T13:16:02.155Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9a249339c37b216a81bec3030883a29","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.160Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-bb1745a7f4af6a5645bd548f: done: 0.018738 sec","job_status":"done","queue_duration_s":0.578563,"scheduling_latency_s":0.578589,"redis_calls":7,"redis_duration_s":0.005858,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003851,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002007,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018738,"completed_at":"2026-08-13T13:16:02.757Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 197.144034] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"31ce0acc571b53a240a6aeb8","created_at":"2026-08-13T13:16:02.172Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bedd984318732335cf2ed49cf92a200","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.175Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-31ce0acc571b53a240a6aeb8: start","job_status":"start","queue_duration_s":0.582906,"scheduling_latency_s":0.582929}1476gitlab # [ 197.215351] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.781Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"31ce0acc571b53a240a6aeb8","created_at":"2026-08-13T13:16:02.172Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bedd984318732335cf2ed49cf92a200","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.175Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-31ce0acc571b53a240a6aeb8: done: 0.022825 sec","job_status":"done","queue_duration_s":0.582906,"scheduling_latency_s":0.582929,"redis_calls":7,"redis_duration_s":0.002568,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00188,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000688,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.022825,"completed_at":"2026-08-13T13:16:02.781Z","load_balancing_strategy":"primary","db_duration_s":0.005323,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 197.217442] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.783Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"440193ee5d62dc20a473e3c4","created_at":"2026-08-13T13:16:02.189Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d62a5101fba3b6923c5cc6b480b1ca26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.192Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-440193ee5d62dc20a473e3c4: start","job_status":"start","queue_duration_s":0.590675,"scheduling_latency_s":0.590699}1478gitlab # [ 197.272060] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.809Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"440193ee5d62dc20a473e3c4","created_at":"2026-08-13T13:16:02.189Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d62a5101fba3b6923c5cc6b480b1ca26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.192Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-440193ee5d62dc20a473e3c4: done: 0.026469 sec","job_status":"done","queue_duration_s":0.590675,"scheduling_latency_s":0.590699,"redis_calls":14,"redis_duration_s":0.002752,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000319,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001883,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00055,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026469,"completed_at":"2026-08-13T13:16:02.809Z","load_balancing_strategy":"primary","db_duration_s":0.001097,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 197.322969] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.811Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9819bcc1f69259d310646615","created_at":"2026-08-13T13:16:02.205Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26cc665338768df664bd4831efa2c802","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.211Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9819bcc1f69259d310646615: start","job_status":"start","queue_duration_s":0.599558,"scheduling_latency_s":0.599592}1480gitlab # [ 197.324046] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.832Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9819bcc1f69259d310646615","created_at":"2026-08-13T13:16:02.205Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26cc665338768df664bd4831efa2c802","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.211Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9819bcc1f69259d310646615: done: 0.02114 sec","job_status":"done","queue_duration_s":0.599558,"scheduling_latency_s":0.599592,"redis_calls":9,"redis_duration_s":0.002162,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001186,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000696178,"exclusive_lock_hold_duration_s":0.003656331,"duration_s":0.02114,"completed_at":"2026-08-13T13:16:02.832Z","load_balancing_strategy":"primary","db_duration_s":0.001307,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 197.341046] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7cb7ebd42677d7a093197371","created_at":"2026-08-13T13:16:02.225Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2da2781e41bec90f142f5dfe8e2b4f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.228Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7cb7ebd42677d7a093197371: start","job_status":"start","queue_duration_s":0.607561,"scheduling_latency_s":0.607616}1482gitlab # [ 197.358228] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.846Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1483gitlab # [ 197.361941] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.854Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7cb7ebd42677d7a093197371","created_at":"2026-08-13T13:16:02.225Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2da2781e41bec90f142f5dfe8e2b4f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.228Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7cb7ebd42677d7a093197371: done: 0.018098 sec","job_status":"done","queue_duration_s":0.607561,"scheduling_latency_s":0.607616,"redis_calls":7,"redis_duration_s":0.001686,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000476,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018098,"completed_at":"2026-08-13T13:16:02.854Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 197.419863] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.856Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"a8155ef97a33aac4964e8bcf","created_at":"2026-08-13T13:16:02.252Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6df244871280edfabbb7652c390c6c5e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.255Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-a8155ef97a33aac4964e8bcf: start","job_status":"start","queue_duration_s":0.600505,"scheduling_latency_s":0.600537}1485gitlab # [ 197.429152] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.866Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1486gitlab # [ 197.433871] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.871Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"a8155ef97a33aac4964e8bcf","created_at":"2026-08-13T13:16:02.252Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6df244871280edfabbb7652c390c6c5e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.255Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-a8155ef97a33aac4964e8bcf: done: 0.015015 sec","job_status":"done","queue_duration_s":0.600505,"scheduling_latency_s":0.600537,"redis_calls":7,"redis_duration_s":0.001696,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001192,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015015,"completed_at":"2026-08-13T13:16:02.871Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 197.501381] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.872Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"3ed103045b42432b856f1082","created_at":"2026-08-13T13:16:02.274Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"108be61320dce3245adf904aea9a1188","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.281Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-3ed103045b42432b856f1082: start","job_status":"start","queue_duration_s":0.591278,"scheduling_latency_s":0.5913}1488gitlab # [ 197.503090] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.892Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"3ed103045b42432b856f1082","created_at":"2026-08-13T13:16:02.274Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"108be61320dce3245adf904aea9a1188","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.281Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-3ed103045b42432b856f1082: done: 0.019315 sec","job_status":"done","queue_duration_s":0.591278,"scheduling_latency_s":0.5913,"redis_calls":12,"redis_duration_s":0.002531,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000454,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000375,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001217,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000485,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000320711,"duration_s":0.019315,"completed_at":"2026-08-13T13:16:02.892Z","load_balancing_strategy":"primary","db_duration_s":0.000564,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 197.557045] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.893Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d1b3b66f6e7c70d54ffd9a3b","created_at":"2026-08-13T13:16:02.295Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f008c16c401b3c1e720d878d7bfeaaca","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.298Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d1b3b66f6e7c70d54ffd9a3b: start","job_status":"start","queue_duration_s":0.595438,"scheduling_latency_s":0.595458}1490gitlab # [ 197.572177] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.906Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d1b3b66f6e7c70d54ffd9a3b","created_at":"2026-08-13T13:16:02.295Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f008c16c401b3c1e720d878d7bfeaaca","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.298Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d1b3b66f6e7c70d54ffd9a3b: done: 0.012942 sec","job_status":"done","queue_duration_s":0.595438,"scheduling_latency_s":0.595458,"redis_calls":7,"redis_duration_s":0.0013379999999999998,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000352,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012942,"completed_at":"2026-08-13T13:16:02.906Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 197.625084] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.907Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"2685fdcc7cb3aff71ec03537","created_at":"2026-08-13T13:16:02.314Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e0273bb2dfc7725b60e260e4419a975","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.321Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-2685fdcc7cb3aff71ec03537: start","job_status":"start","queue_duration_s":0.586517,"scheduling_latency_s":0.586536}1492gitlab # [ 197.635974] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.956Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"2685fdcc7cb3aff71ec03537","created_at":"2026-08-13T13:16:02.314Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e0273bb2dfc7725b60e260e4419a975","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.321Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-2685fdcc7cb3aff71ec03537: done: 0.049145 sec","job_status":"done","queue_duration_s":0.586517,"scheduling_latency_s":0.586536,"redis_calls":9,"redis_duration_s":0.004399999999999999,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003312,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000569905,"exclusive_lock_hold_duration_s":0.029130239,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.049145,"completed_at":"2026-08-13T13:16:02.956Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 197.724244] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:02.958Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c803f78dc033ee0d3bb6b8d6","created_at":"2026-08-13T13:16:02.341Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd256f4155337995dd4e318263f8a20c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.345Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c803f78dc033ee0d3bb6b8d6: start","job_status":"start","queue_duration_s":0.61274,"scheduling_latency_s":0.612781}1494gitlab # [ 197.725346] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.390Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c803f78dc033ee0d3bb6b8d6","created_at":"2026-08-13T13:16:02.341Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd256f4155337995dd4e318263f8a20c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.345Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c803f78dc033ee0d3bb6b8d6: done: 0.431332 sec","job_status":"done","queue_duration_s":0.61274,"scheduling_latency_s":0.612781,"redis_calls":562,"redis_duration_s":0.126068,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001246,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.124822,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.347071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.431332,"completed_at":"2026-08-13T13:16:03.390Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 197.788478] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.391Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"5b33702697bb245cd8ee473a","created_at":"2026-08-13T13:16:02.360Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5ca0aff6db7082e80c59f862d809e96","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.372Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-5b33702697bb245cd8ee473a: start","job_status":"start","queue_duration_s":1.019592,"scheduling_latency_s":1.019622}1496gitlab # [ 197.789985] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.419Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"5b33702697bb245cd8ee473a","created_at":"2026-08-13T13:16:02.360Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5ca0aff6db7082e80c59f862d809e96","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.372Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-5b33702697bb245cd8ee473a: done: 0.027587 sec","job_status":"done","queue_duration_s":1.019592,"scheduling_latency_s":1.019622,"redis_calls":12,"redis_duration_s":0.004147,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000574,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002237,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001336,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000454527,"exclusive_lock_hold_duration_s":0.004079848,"duration_s":0.027587,"completed_at":"2026-08-13T13:16:03.419Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 197.854944] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.421Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5086f80fea7603a9383efc2d","created_at":"2026-08-13T13:16:02.381Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0547238a903c40c348c42991e8debb39","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.386Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5086f80fea7603a9383efc2d: start","job_status":"start","queue_duration_s":1.034501,"scheduling_latency_s":1.034525}1498gitlab # [ 197.856048] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5086f80fea7603a9383efc2d","created_at":"2026-08-13T13:16:02.381Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0547238a903c40c348c42991e8debb39","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.386Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5086f80fea7603a9383efc2d: done: 0.016831 sec","job_status":"done","queue_duration_s":1.034501,"scheduling_latency_s":1.034525,"redis_calls":7,"redis_duration_s":0.0019169999999999999,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00137,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000547,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016831,"completed_at":"2026-08-13T13:16:03.437Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 197.920125] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.439Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"db80e929c79114e5f13327c4","created_at":"2026-08-13T13:16:02.399Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ee4a7a5ae7ca932b217aa9caf6fd99af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-13T13:16:02.402Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-db80e929c79114e5f13327c4: start","job_status":"start","queue_duration_s":1.036783,"scheduling_latency_s":1.036813}1500gitlab # [ 197.921137] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.449Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1501gitlab # [ 197.921922] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.459Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"db80e929c79114e5f13327c4","created_at":"2026-08-13T13:16:02.399Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ee4a7a5ae7ca932b217aa9caf6fd99af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-13T13:16:02.402Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-db80e929c79114e5f13327c4: done: 0.019464 sec","job_status":"done","queue_duration_s":1.036783,"scheduling_latency_s":1.036813,"redis_calls":7,"redis_duration_s":0.0046,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003967,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000633,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019464,"completed_at":"2026-08-13T13:16:03.459Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 197.973251] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.460Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"8352f8efaed92f68def625ae","created_at":"2026-08-13T13:16:02.419Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7035e63b96bfb61b71dc02bf639a5b98","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.421Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-8352f8efaed92f68def625ae: start","job_status":"start","queue_duration_s":1.038725,"scheduling_latency_s":1.038749}1503gitlab # [ 197.974424] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"8352f8efaed92f68def625ae","created_at":"2026-08-13T13:16:02.419Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7035e63b96bfb61b71dc02bf639a5b98","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.421Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-8352f8efaed92f68def625ae: done: 0.036906 sec","job_status":"done","queue_duration_s":1.038725,"scheduling_latency_s":1.038749,"redis_calls":9,"redis_duration_s":0.002493,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001351,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001142,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000808762,"exclusive_lock_hold_duration_s":0.012444877,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.036906,"completed_at":"2026-08-13T13:16:03.497Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012651,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 198.032996] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.499Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"6a491f7a54816132ff9772f8","created_at":"2026-08-13T13:16:02.450Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d254f2f0a3cff01c2b03222fcc01ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.452Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-6a491f7a54816132ff9772f8: start","job_status":"start","queue_duration_s":1.046517,"scheduling_latency_s":1.046538}1505gitlab # [ 198.085195] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.506Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1506gitlab # [ 198.086158] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.510Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"6a491f7a54816132ff9772f8","created_at":"2026-08-13T13:16:02.450Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d254f2f0a3cff01c2b03222fcc01ff9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.452Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-6a491f7a54816132ff9772f8: done: 0.011419 sec","job_status":"done","queue_duration_s":1.046517,"scheduling_latency_s":1.046538,"redis_calls":7,"redis_duration_s":0.001472,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001034,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000438,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011419,"completed_at":"2026-08-13T13:16:03.510Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 198.092937] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.511Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"3859f2dcc18d8a1ac8c81838","created_at":"2026-08-13T13:16:02.467Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"458564862619e10a88326ee83b7170ed","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.476Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-3859f2dcc18d8a1ac8c81838: start","job_status":"start","queue_duration_s":1.03472,"scheduling_latency_s":1.034739}1508gitlab # [ 198.152512] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"3859f2dcc18d8a1ac8c81838","created_at":"2026-08-13T13:16:02.467Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"458564862619e10a88326ee83b7170ed","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.476Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-3859f2dcc18d8a1ac8c81838: done: 0.028847 sec","job_status":"done","queue_duration_s":1.03472,"scheduling_latency_s":1.034739,"redis_calls":10,"redis_duration_s":0.00294,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000601,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000571,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000482184,"duration_s":0.028847,"completed_at":"2026-08-13T13:16:03.540Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002885,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 198.212704] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.542Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"cd664585cff3dd5325c95d48","created_at":"2026-08-13T13:16:02.486Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f45c847ddef60e84129412ee9eaf3bc","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.496Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-cd664585cff3dd5325c95d48: start","job_status":"start","queue_duration_s":1.046451,"scheduling_latency_s":1.046479}1510gitlab # [ 198.214049] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.564Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"cd664585cff3dd5325c95d48","created_at":"2026-08-13T13:16:02.486Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f45c847ddef60e84129412ee9eaf3bc","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.496Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-cd664585cff3dd5325c95d48: done: 0.022023 sec","job_status":"done","queue_duration_s":1.046451,"scheduling_latency_s":1.046479,"redis_calls":10,"redis_duration_s":0.002666,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001561,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001105,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005207924,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.022023,"completed_at":"2026-08-13T13:16:03.564Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002647,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1511gitlab # [ 198.234911] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.566Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"64e97ad88e9c7b2da2da26e6","created_at":"2026-08-13T13:16:02.506Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4af284104dcdc9fcf8ceddc8fa712548","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.511Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-64e97ad88e9c7b2da2da26e6: start","job_status":"start","queue_duration_s":1.054769,"scheduling_latency_s":1.054833}1512gitlab # [ 198.256523] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"64e97ad88e9c7b2da2da26e6","created_at":"2026-08-13T13:16:02.506Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4af284104dcdc9fcf8ceddc8fa712548","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.511Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-64e97ad88e9c7b2da2da26e6: done: 0.016353 sec","job_status":"done","queue_duration_s":1.054769,"scheduling_latency_s":1.054833,"redis_calls":9,"redis_duration_s":0.00236,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001245,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001115,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000414578,"exclusive_lock_hold_duration_s":0.002248331,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.016353,"completed_at":"2026-08-13T13:16:03.582Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001143,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 198.319774] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0bc042fa3891c41676647623","created_at":"2026-08-13T13:16:02.523Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"70283f21adb75d9c0fe601750faec1c1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T13:16:02.531Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0bc042fa3891c41676647623: start","job_status":"start","queue_duration_s":1.052511,"scheduling_latency_s":1.052534}1514gitlab # [ 198.384458] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.605Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0bc042fa3891c41676647623","created_at":"2026-08-13T13:16:02.523Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"70283f21adb75d9c0fe601750faec1c1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-13T13:16:02.531Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0bc042fa3891c41676647623: done: 0.021432 sec","job_status":"done","queue_duration_s":1.052511,"scheduling_latency_s":1.052534,"redis_calls":7,"redis_duration_s":0.001973,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001385,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000588,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021432,"completed_at":"2026-08-13T13:16:03.605Z","load_balancing_strategy":"primary","db_duration_s":0.001748,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 198.389081] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.607Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"3883943528cbc58c920068aa","created_at":"2026-08-13T13:16:02.543Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"2bb4a43f847e555dede1c7d4998bf9f4","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.554Z","job_size_bytes":3,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-3883943528cbc58c920068aa: start","job_status":"start","queue_duration_s":1.052603,"scheduling_latency_s":1.052637}1516gitlab # [ 198.444955] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.629Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"3883943528cbc58c920068aa","created_at":"2026-08-13T13:16:02.543Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"2bb4a43f847e555dede1c7d4998bf9f4","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.554Z","job_size_bytes":3,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-3883943528cbc58c920068aa: done: 0.021813 sec","job_status":"done","queue_duration_s":1.052603,"scheduling_latency_s":1.052637,"redis_calls":10,"redis_duration_s":0.0024000000000000002,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000535,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001333,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000532,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000339708,"duration_s":0.021813,"completed_at":"2026-08-13T13:16:03.629Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00075,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 198.459586] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.630Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"48cb7e7a424be20874507e05","created_at":"2026-08-13T13:16:02.576Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66c890ee63043080d23805a32f032c8f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.580Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-48cb7e7a424be20874507e05: start","job_status":"start","queue_duration_s":1.049731,"scheduling_latency_s":1.049749}1518gitlab # [ 198.477379] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.647Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"48cb7e7a424be20874507e05","created_at":"2026-08-13T13:16:02.576Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66c890ee63043080d23805a32f032c8f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.580Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-48cb7e7a424be20874507e05: done: 0.016645 sec","job_status":"done","queue_duration_s":1.049731,"scheduling_latency_s":1.049749,"redis_calls":7,"redis_duration_s":0.0017139999999999998,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001267,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000447,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016645,"completed_at":"2026-08-13T13:16:03.647Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 198.545455] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.648Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b57d3ba1fc7bb93ffac71f15","created_at":"2026-08-13T13:16:02.590Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c801c48ec2e5582cf2a294acf7fa7822","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.592Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b57d3ba1fc7bb93ffac71f15: start","job_status":"start","queue_duration_s":1.056123,"scheduling_latency_s":1.056148}1520gitlab # [ 198.553214] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.662Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b57d3ba1fc7bb93ffac71f15","created_at":"2026-08-13T13:16:02.590Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c801c48ec2e5582cf2a294acf7fa7822","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.592Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b57d3ba1fc7bb93ffac71f15: done: 0.01413 sec","job_status":"done","queue_duration_s":1.056123,"scheduling_latency_s":1.056148,"redis_calls":7,"redis_duration_s":0.001438,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01413,"completed_at":"2026-08-13T13:16:03.662Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 198.626938] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.664Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a053118455b4990475b41b0c","created_at":"2026-08-13T13:16:02.611Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.613Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a053118455b4990475b41b0c: start","job_status":"start","queue_duration_s":1.050772,"scheduling_latency_s":1.050796}1522gitlab # [ 198.628250] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.754Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a053118455b4990475b41b0c","created_at":"2026-08-13T13:16:02.611Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-fc2fd009a0fb4b6f","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.613Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a053118455b4990475b41b0c: done: 0.090073 sec","job_status":"done","queue_duration_s":1.050772,"scheduling_latency_s":1.050796,"redis_calls":60,"redis_duration_s":0.015453999999999999,"redis_read_bytes":109,"redis_write_bytes":41009,"redis_queues_calls":2,"redis_queues_duration_s":0.00081,"redis_queues_read_bytes":4,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013947,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000697,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090073,"completed_at":"2026-08-13T13:16:03.754Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 198.684943] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ebe10866cc58dabb841df1c1","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ebe10866cc58dabb841df1c1: start","job_status":"start","queue_duration_s":1.028242,"scheduling_latency_s":1.028273}1524gitlab # [ 198.691400] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ebe10866cc58dabb841df1c1","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ebe10866cc58dabb841df1c1: done: 0.042106 sec","job_status":"done","queue_duration_s":1.028242,"scheduling_latency_s":1.028273,"redis_calls":13,"redis_duration_s":0.003645,"redis_read_bytes":12,"redis_write_bytes":1300,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000448,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":289,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00139,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":395,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001807,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":616,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000500063,"duration_s":0.042106,"completed_at":"2026-08-13T13:16:03.798Z","load_balancing_strategy":"primary","db_duration_s":0.008004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 198.746805] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9ee346cf4f8349fac6c3c317","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9ee346cf4f8349fac6c3c317: start","job_status":"start","queue_duration_s":1.072512,"scheduling_latency_s":1.072552}1526gitlab # [ 198.753195] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9ee346cf4f8349fac6c3c317","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9ee346cf4f8349fac6c3c317: done: 0.023108 sec","job_status":"done","queue_duration_s":1.072512,"scheduling_latency_s":1.072552,"redis_calls":10,"redis_duration_s":0.002979,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001502,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023108,"completed_at":"2026-08-13T13:16:03.823Z","load_balancing_strategy":"primary","db_duration_s":0.001919,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 198.838066] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"40cb12ecd6e4d78b2a12e172","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-40cb12ecd6e4d78b2a12e172: start","job_status":"start","queue_duration_s":1.096958,"scheduling_latency_s":1.097014}1528gitlab # [ 198.839003] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"40cb12ecd6e4d78b2a12e172","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-40cb12ecd6e4d78b2a12e172: done: 0.017125 sec","job_status":"done","queue_duration_s":1.096958,"scheduling_latency_s":1.097014,"redis_calls":10,"redis_duration_s":0.002062,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001266,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017125,"completed_at":"2026-08-13T13:16:03.842Z","load_balancing_strategy":"primary","db_duration_s":0.001791,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 198.895852] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4c2c254af2654ff4689e5a32","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4c2c254af2654ff4689e5a32: start","job_status":"start","queue_duration_s":1.115546,"scheduling_latency_s":1.115574}1530gitlab # [ 198.897175] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4c2c254af2654ff4689e5a32","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4c2c254af2654ff4689e5a32: done: 0.02162 sec","job_status":"done","queue_duration_s":1.115546,"scheduling_latency_s":1.115574,"redis_calls":10,"redis_duration_s":0.002371,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000983,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001388,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02162,"completed_at":"2026-08-13T13:16:03.865Z","load_balancing_strategy":"primary","db_duration_s":0.001745,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 198.921258] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9e2657993896cdf907760ea5","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9e2657993896cdf907760ea5: start","job_status":"start","queue_duration_s":1.138715,"scheduling_latency_s":1.138742}1532gitlab # [ 198.981446] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9e2657993896cdf907760ea5","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9e2657993896cdf907760ea5: done: 0.018469 sec","job_status":"done","queue_duration_s":1.138715,"scheduling_latency_s":1.138742,"redis_calls":10,"redis_duration_s":0.002189,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001373,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018469,"completed_at":"2026-08-13T13:16:03.885Z","load_balancing_strategy":"primary","db_duration_s":0.001529,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 198.987216] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e752cc7496a4ea4d0cfca456","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e752cc7496a4ea4d0cfca456: start","job_status":"start","queue_duration_s":1.158526,"scheduling_latency_s":1.158549}1534gitlab # [ 199.002798] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e752cc7496a4ea4d0cfca456","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e752cc7496a4ea4d0cfca456: done: 0.023579 sec","job_status":"done","queue_duration_s":1.158526,"scheduling_latency_s":1.158549,"redis_calls":10,"redis_duration_s":0.002371,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001404,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023579,"completed_at":"2026-08-13T13:16:03.910Z","load_balancing_strategy":"primary","db_duration_s":0.002785,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 199.063849] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3a282738e841a9415c27c07d","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3a282738e841a9415c27c07d: start","job_status":"start","queue_duration_s":1.183517,"scheduling_latency_s":1.183544}1536gitlab # [ 199.064778] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3a282738e841a9415c27c07d","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3a282738e841a9415c27c07d: done: 0.017174 sec","job_status":"done","queue_duration_s":1.183517,"scheduling_latency_s":1.183544,"redis_calls":10,"redis_duration_s":0.00198,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001156,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017174,"completed_at":"2026-08-13T13:16:03.928Z","load_balancing_strategy":"primary","db_duration_s":0.001775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 199.130921] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a4d9556c904d11f5796f8795","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a4d9556c904d11f5796f8795: start","job_status":"start","queue_duration_s":1.20234,"scheduling_latency_s":1.202363}1538gitlab # [ 199.131899] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a4d9556c904d11f5796f8795","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a4d9556c904d11f5796f8795: done: 0.020434 sec","job_status":"done","queue_duration_s":1.20234,"scheduling_latency_s":1.202363,"redis_calls":10,"redis_duration_s":0.002295,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001449,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020434,"completed_at":"2026-08-13T13:16:03.950Z","load_balancing_strategy":"primary","db_duration_s":0.002161,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 199.188051] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f50deee4a8a05a16f3a4d937","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f50deee4a8a05a16f3a4d937: start","job_status":"start","queue_duration_s":1.22477,"scheduling_latency_s":1.224803}1540gitlab # [ 199.190979] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f50deee4a8a05a16f3a4d937","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f50deee4a8a05a16f3a4d937: done: 0.018225 sec","job_status":"done","queue_duration_s":1.22477,"scheduling_latency_s":1.224803,"redis_calls":10,"redis_duration_s":0.002442,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001549,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018225,"completed_at":"2026-08-13T13:16:03.971Z","load_balancing_strategy":"primary","db_duration_s":0.001892,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 199.257861] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c8f5077875de9737eedee8c1","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c8f5077875de9737eedee8c1: start","job_status":"start","queue_duration_s":1.24429,"scheduling_latency_s":1.244309}1542gitlab # [ 199.258867] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c8f5077875de9737eedee8c1","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c8f5077875de9737eedee8c1: done: 0.020894 sec","job_status":"done","queue_duration_s":1.24429,"scheduling_latency_s":1.244309,"redis_calls":10,"redis_duration_s":0.002447,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001497,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020894,"completed_at":"2026-08-13T13:16:03.993Z","load_balancing_strategy":"primary","db_duration_s":0.003737,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 199.317917] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:03.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"58b877656afca9449df0ca1c","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-58b877656afca9449df0ca1c: start","job_status":"start","queue_duration_s":1.266896,"scheduling_latency_s":1.266926}1544gitlab # [ 199.319111] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"58b877656afca9449df0ca1c","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-58b877656afca9449df0ca1c: done: 0.023747 sec","job_status":"done","queue_duration_s":1.266896,"scheduling_latency_s":1.266926,"redis_calls":10,"redis_duration_s":0.002296,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001359,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023747,"completed_at":"2026-08-13T13:16:04.018Z","load_balancing_strategy":"primary","db_duration_s":0.001832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 199.357857] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f3b3b89ef314debdfbeb300a","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f3b3b89ef314debdfbeb300a: start","job_status":"start","queue_duration_s":1.293107,"scheduling_latency_s":1.293144}1546gitlab # [ 199.422187] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f3b3b89ef314debdfbeb300a","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f3b3b89ef314debdfbeb300a: done: 0.020824 sec","job_status":"done","queue_duration_s":1.293107,"scheduling_latency_s":1.293144,"redis_calls":10,"redis_duration_s":0.002792,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001833,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020824,"completed_at":"2026-08-13T13:16:04.042Z","load_balancing_strategy":"primary","db_duration_s":0.001722,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 199.423195] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d51608e43f3e490798dca308","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d51608e43f3e490798dca308: start","job_status":"start","queue_duration_s":1.315533,"scheduling_latency_s":1.315558}1548gitlab # [ 199.434789] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d51608e43f3e490798dca308","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d51608e43f3e490798dca308: done: 0.068576 sec","job_status":"done","queue_duration_s":1.315533,"scheduling_latency_s":1.315558,"redis_calls":10,"redis_duration_s":0.00295,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001633,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.046,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.046,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.068576,"completed_at":"2026-08-13T13:16:04.112Z","load_balancing_strategy":"primary","db_duration_s":0.002102,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 199.509127] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d580ccd542ce10b0bc111563","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d580ccd542ce10b0bc111563: start","job_status":"start","queue_duration_s":1.385662,"scheduling_latency_s":1.385693}1550gitlab # [ 199.510339] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d580ccd542ce10b0bc111563","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d580ccd542ce10b0bc111563: done: 0.022712 sec","job_status":"done","queue_duration_s":1.385662,"scheduling_latency_s":1.385693,"redis_calls":10,"redis_duration_s":0.0024349999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001016,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001419,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022712,"completed_at":"2026-08-13T13:16:04.136Z","load_balancing_strategy":"primary","db_duration_s":0.001872,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 199.588780] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"65617fe1853030e685544273","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-65617fe1853030e685544273: start","job_status":"start","queue_duration_s":1.40993,"scheduling_latency_s":1.409954}1552gitlab # [ 199.589981] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"65617fe1853030e685544273","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-65617fe1853030e685544273: done: 0.022196 sec","job_status":"done","queue_duration_s":1.40993,"scheduling_latency_s":1.409954,"redis_calls":10,"redis_duration_s":0.003791,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002863,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022196,"completed_at":"2026-08-13T13:16:04.160Z","load_balancing_strategy":"primary","db_duration_s":0.001909,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 199.651273] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7b3cedb9fe18c2ad1ef2348a","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7b3cedb9fe18c2ad1ef2348a: start","job_status":"start","queue_duration_s":1.434318,"scheduling_latency_s":1.434344}1554gitlab # [ 199.652324] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7b3cedb9fe18c2ad1ef2348a","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7b3cedb9fe18c2ad1ef2348a: done: 0.023761 sec","job_status":"done","queue_duration_s":1.434318,"scheduling_latency_s":1.434344,"redis_calls":10,"redis_duration_s":0.002634,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001614,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023761,"completed_at":"2026-08-13T13:16:04.186Z","load_balancing_strategy":"primary","db_duration_s":0.002237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 199.665095] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"536d075cc41601cd80b9a1a1","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-536d075cc41601cd80b9a1a1: start","job_status":"start","queue_duration_s":1.459862,"scheduling_latency_s":1.459898}1556gitlab # [ 199.722330] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"536d075cc41601cd80b9a1a1","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-536d075cc41601cd80b9a1a1: done: 0.022442 sec","job_status":"done","queue_duration_s":1.459862,"scheduling_latency_s":1.459898,"redis_calls":10,"redis_duration_s":0.002222,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001367,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022442,"completed_at":"2026-08-13T13:16:04.210Z","load_balancing_strategy":"primary","db_duration_s":0.002155,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 199.723953] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"664ced22ab2f44e80cff2f64","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-664ced22ab2f44e80cff2f64: start","job_status":"start","queue_duration_s":1.483566,"scheduling_latency_s":1.483598}1558gitlab # [ 199.781138] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"664ced22ab2f44e80cff2f64","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-664ced22ab2f44e80cff2f64: done: 0.01695 sec","job_status":"done","queue_duration_s":1.483566,"scheduling_latency_s":1.483598,"redis_calls":10,"redis_duration_s":0.002016,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000819,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001197,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01695,"completed_at":"2026-08-13T13:16:04.228Z","load_balancing_strategy":"primary","db_duration_s":0.001616,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 199.783743] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1f8ea8e89f241c1b403c93a1","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1f8ea8e89f241c1b403c93a1: start","job_status":"start","queue_duration_s":1.502808,"scheduling_latency_s":1.502846}1560gitlab # [ 199.799297] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1f8ea8e89f241c1b403c93a1","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1f8ea8e89f241c1b403c93a1: done: 0.020656 sec","job_status":"done","queue_duration_s":1.502808,"scheduling_latency_s":1.502846,"redis_calls":10,"redis_duration_s":0.002227,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001255,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020656,"completed_at":"2026-08-13T13:16:04.251Z","load_balancing_strategy":"primary","db_duration_s":0.00192,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 199.858981] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"19d5e4ceea5f2bb52143ceab","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-19d5e4ceea5f2bb52143ceab: start","job_status":"start","queue_duration_s":1.525948,"scheduling_latency_s":1.526017}1562gitlab # [ 199.860081] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"19d5e4ceea5f2bb52143ceab","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-19d5e4ceea5f2bb52143ceab: done: 0.023002 sec","job_status":"done","queue_duration_s":1.525948,"scheduling_latency_s":1.526017,"redis_calls":10,"redis_duration_s":0.003462,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001367,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002095,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023002,"completed_at":"2026-08-13T13:16:04.277Z","load_balancing_strategy":"primary","db_duration_s":0.001941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 199.919952] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"215c3b8968e44855ad7878c2","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-215c3b8968e44855ad7878c2: start","job_status":"start","queue_duration_s":1.550715,"scheduling_latency_s":1.550738}1564gitlab # [ 199.920902] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"215c3b8968e44855ad7878c2","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-215c3b8968e44855ad7878c2: done: 0.023111 sec","job_status":"done","queue_duration_s":1.550715,"scheduling_latency_s":1.550738,"redis_calls":10,"redis_duration_s":0.0025599999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001589,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023111,"completed_at":"2026-08-13T13:16:04.301Z","load_balancing_strategy":"primary","db_duration_s":0.002244,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 199.975411] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e7c4f8abdaba87586d30015e","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e7c4f8abdaba87586d30015e: start","job_status":"start","queue_duration_s":1.575426,"scheduling_latency_s":1.575454}1566gitlab # [ 199.976566] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e7c4f8abdaba87586d30015e","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e7c4f8abdaba87586d30015e: done: 0.02375 sec","job_status":"done","queue_duration_s":1.575426,"scheduling_latency_s":1.575454,"redis_calls":10,"redis_duration_s":0.0034519999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002466,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02375,"completed_at":"2026-08-13T13:16:04.327Z","load_balancing_strategy":"primary","db_duration_s":0.00183,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 200.030159] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"72d06565567d8264c9f9e8de","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-72d06565567d8264c9f9e8de: start","job_status":"start","queue_duration_s":1.602015,"scheduling_latency_s":1.602049}1568gitlab # [ 200.034134] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"72d06565567d8264c9f9e8de","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-72d06565567d8264c9f9e8de: done: 0.024696 sec","job_status":"done","queue_duration_s":1.602015,"scheduling_latency_s":1.602049,"redis_calls":10,"redis_duration_s":0.002437,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001465,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024696,"completed_at":"2026-08-13T13:16:04.354Z","load_balancing_strategy":"primary","db_duration_s":0.001516,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 200.122087] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7fc66dd22e2a45da5b7364fa","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7fc66dd22e2a45da5b7364fa: start","job_status":"start","queue_duration_s":1.62862,"scheduling_latency_s":1.628646}1570gitlab # [ 200.123247] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7fc66dd22e2a45da5b7364fa","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7fc66dd22e2a45da5b7364fa: done: 0.018332 sec","job_status":"done","queue_duration_s":1.62862,"scheduling_latency_s":1.628646,"redis_calls":10,"redis_duration_s":0.0029490000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001381,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018332,"completed_at":"2026-08-13T13:16:04.375Z","load_balancing_strategy":"primary","db_duration_s":0.00204,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 200.140880] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3a440f4b213d49b4b511cb1a","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3a440f4b213d49b4b511cb1a: start","job_status":"start","queue_duration_s":1.648308,"scheduling_latency_s":1.648328}1572gitlab # [ 200.156107] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.397Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3a440f4b213d49b4b511cb1a","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3a440f4b213d49b4b511cb1a: done: 0.020551 sec","job_status":"done","queue_duration_s":1.648308,"scheduling_latency_s":1.648328,"redis_calls":10,"redis_duration_s":0.003282,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001416,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020551,"completed_at":"2026-08-13T13:16:04.396Z","load_balancing_strategy":"primary","db_duration_s":0.001922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 200.215853] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1caef83b3aec04b4e86d3064","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1caef83b3aec04b4e86d3064: start","job_status":"start","queue_duration_s":1.670439,"scheduling_latency_s":1.670462}1574gitlab # [ 200.276219] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1caef83b3aec04b4e86d3064","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1caef83b3aec04b4e86d3064: done: 0.016422 sec","job_status":"done","queue_duration_s":1.670439,"scheduling_latency_s":1.670462,"redis_calls":10,"redis_duration_s":0.001974,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000794,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00118,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016422,"completed_at":"2026-08-13T13:16:04.414Z","load_balancing_strategy":"primary","db_duration_s":0.00217,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 200.277946] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"568a09f41e2552af31d43b9f","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-568a09f41e2552af31d43b9f: start","job_status":"start","queue_duration_s":1.688121,"scheduling_latency_s":1.68814}1576gitlab # [ 200.285799] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"568a09f41e2552af31d43b9f","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-568a09f41e2552af31d43b9f: done: 0.023638 sec","job_status":"done","queue_duration_s":1.688121,"scheduling_latency_s":1.68814,"redis_calls":10,"redis_duration_s":0.0052309999999999995,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00154,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003691,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023638,"completed_at":"2026-08-13T13:16:04.439Z","load_balancing_strategy":"primary","db_duration_s":0.001738,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 200.349903] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"80393fbe492b64e49f56ae41","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-80393fbe492b64e49f56ae41: start","job_status":"start","queue_duration_s":1.714218,"scheduling_latency_s":1.714255}1578gitlab # [ 200.350955] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"80393fbe492b64e49f56ae41","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-80393fbe492b64e49f56ae41: done: 0.025338 sec","job_status":"done","queue_duration_s":1.714218,"scheduling_latency_s":1.714255,"redis_calls":10,"redis_duration_s":0.00243,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001016,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001414,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025338,"completed_at":"2026-08-13T13:16:04.467Z","load_balancing_strategy":"primary","db_duration_s":0.001926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579gitlab # [ 200.410245] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d25373c552742e7b751df428","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d25373c552742e7b751df428: start","job_status":"start","queue_duration_s":1.741302,"scheduling_latency_s":1.741335}1580gitlab # [ 200.411646] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d25373c552742e7b751df428","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d25373c552742e7b751df428: done: 0.020697 sec","job_status":"done","queue_duration_s":1.741302,"scheduling_latency_s":1.741335,"redis_calls":10,"redis_duration_s":0.002254,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001328,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020697,"completed_at":"2026-08-13T13:16:04.490Z","load_balancing_strategy":"primary","db_duration_s":0.001812,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581gitlab # [ 200.498919] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"51ad406811487d7678c00d58","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-51ad406811487d7678c00d58: start","job_status":"start","queue_duration_s":1.763344,"scheduling_latency_s":1.763365}1582gitlab # [ 200.499796] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"51ad406811487d7678c00d58","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-51ad406811487d7678c00d58: done: 0.01597 sec","job_status":"done","queue_duration_s":1.763344,"scheduling_latency_s":1.763365,"redis_calls":10,"redis_duration_s":0.00223,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001353,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01597,"completed_at":"2026-08-13T13:16:04.507Z","load_balancing_strategy":"primary","db_duration_s":0.001818,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 200.512260] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6f1df140fd245d0ca9fb6c89","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6f1df140fd245d0ca9fb6c89: start","job_status":"start","queue_duration_s":1.780631,"scheduling_latency_s":1.780653}1584gitlab # [ 200.562959] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6f1df140fd245d0ca9fb6c89","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6f1df140fd245d0ca9fb6c89: done: 0.018433 sec","job_status":"done","queue_duration_s":1.780631,"scheduling_latency_s":1.780653,"redis_calls":10,"redis_duration_s":0.002094,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001229,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018433,"completed_at":"2026-08-13T13:16:04.527Z","load_balancing_strategy":"primary","db_duration_s":0.001627,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 200.568592] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d61a2cd337401a8883252a18","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d61a2cd337401a8883252a18: start","job_status":"start","queue_duration_s":1.800351,"scheduling_latency_s":1.800373}1586gitlab # [ 200.623953] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d61a2cd337401a8883252a18","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d61a2cd337401a8883252a18: done: 0.019137 sec","job_status":"done","queue_duration_s":1.800351,"scheduling_latency_s":1.800373,"redis_calls":10,"redis_duration_s":0.0024939999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00155,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019137,"completed_at":"2026-08-13T13:16:04.547Z","load_balancing_strategy":"primary","db_duration_s":0.001707,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 200.627132] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b6e02adf7f2b59b4a0a9f6d7","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b6e02adf7f2b59b4a0a9f6d7: start","job_status":"start","queue_duration_s":1.822397,"scheduling_latency_s":1.822432}1588gitlab # [ 200.683416] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b6e02adf7f2b59b4a0a9f6d7","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b6e02adf7f2b59b4a0a9f6d7: done: 0.01915 sec","job_status":"done","queue_duration_s":1.822397,"scheduling_latency_s":1.822432,"redis_calls":10,"redis_duration_s":0.002736,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000813,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001923,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0123,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01915,"completed_at":"2026-08-13T13:16:04.569Z","load_balancing_strategy":"primary","db_duration_s":0.001845,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 200.684844] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"91270db6f98dbcbcb75bffab","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-91270db6f98dbcbcb75bffab: start","job_status":"start","queue_duration_s":1.842834,"scheduling_latency_s":1.842855}1590gitlab # [ 200.699705] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"91270db6f98dbcbcb75bffab","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-91270db6f98dbcbcb75bffab: done: 0.016307 sec","job_status":"done","queue_duration_s":1.842834,"scheduling_latency_s":1.842855,"redis_calls":10,"redis_duration_s":0.001921,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001155,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016307,"completed_at":"2026-08-13T13:16:04.587Z","load_balancing_strategy":"primary","db_duration_s":0.001622,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 200.773893] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"81859f648dd315d988f4df52","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-81859f648dd315d988f4df52: start","job_status":"start","queue_duration_s":1.860376,"scheduling_latency_s":1.860395}1592gitlab # [ 200.774892] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"81859f648dd315d988f4df52","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-81859f648dd315d988f4df52: done: 0.020974 sec","job_status":"done","queue_duration_s":1.860376,"scheduling_latency_s":1.860395,"redis_calls":10,"redis_duration_s":0.0026040000000000004,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001543,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020974,"completed_at":"2026-08-13T13:16:04.609Z","load_balancing_strategy":"primary","db_duration_s":0.002046,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 200.804834] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c45bd8408aa1845c4e42d90c","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c45bd8408aa1845c4e42d90c: start","job_status":"start","queue_duration_s":1.883788,"scheduling_latency_s":1.883817}1594gitlab # [ 200.859894] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c45bd8408aa1845c4e42d90c","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c45bd8408aa1845c4e42d90c: done: 0.026939 sec","job_status":"done","queue_duration_s":1.883788,"scheduling_latency_s":1.883817,"redis_calls":10,"redis_duration_s":0.004828000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003236,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001592,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026939,"completed_at":"2026-08-13T13:16:04.638Z","load_balancing_strategy":"primary","db_duration_s":0.002147,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595gitlab # [ 200.863749] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"105f09751233fe0bf6812dbe","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-105f09751233fe0bf6812dbe: start","job_status":"start","queue_duration_s":1.912367,"scheduling_latency_s":1.912395}1596gitlab # [ 200.922115] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"105f09751233fe0bf6812dbe","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-105f09751233fe0bf6812dbe: done: 0.02394 sec","job_status":"done","queue_duration_s":1.912367,"scheduling_latency_s":1.912395,"redis_calls":10,"redis_duration_s":0.00261,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001571,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02394,"completed_at":"2026-08-13T13:16:04.664Z","load_balancing_strategy":"primary","db_duration_s":0.002145,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 200.923806] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f7098094cf6fffcc93b62cad","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f7098094cf6fffcc93b62cad: start","job_status":"start","queue_duration_s":1.937948,"scheduling_latency_s":1.938011}1598gitlab # [ 200.938389] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f7098094cf6fffcc93b62cad","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f7098094cf6fffcc93b62cad: done: 0.022193 sec","job_status":"done","queue_duration_s":1.937948,"scheduling_latency_s":1.938011,"redis_calls":10,"redis_duration_s":0.00404,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002668,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001372,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022193,"completed_at":"2026-08-13T13:16:04.688Z","load_balancing_strategy":"primary","db_duration_s":0.001787,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 200.985353] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0a35d3414f8b3df32813b4b7","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0a35d3414f8b3df32813b4b7: start","job_status":"start","queue_duration_s":1.961459,"scheduling_latency_s":1.96148}1600gitlab # [ 201.041086] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0a35d3414f8b3df32813b4b7","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0a35d3414f8b3df32813b4b7: done: 0.017131 sec","job_status":"done","queue_duration_s":1.961459,"scheduling_latency_s":1.96148,"redis_calls":10,"redis_duration_s":0.0020480000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001226,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017131,"completed_at":"2026-08-13T13:16:04.706Z","load_balancing_strategy":"primary","db_duration_s":0.001548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601gitlab # [ 201.045235] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f20dbf61c9129d2cbb9c802b","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f20dbf61c9129d2cbb9c802b: start","job_status":"start","queue_duration_s":1.979874,"scheduling_latency_s":1.979899}1602gitlab # [ 201.098308] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f20dbf61c9129d2cbb9c802b","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f20dbf61c9129d2cbb9c802b: done: 0.019797 sec","job_status":"done","queue_duration_s":1.979874,"scheduling_latency_s":1.979899,"redis_calls":10,"redis_duration_s":0.002299,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001418,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019797,"completed_at":"2026-08-13T13:16:04.727Z","load_balancing_strategy":"primary","db_duration_s":0.002819,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 201.104839] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"669315db0393f55824d14fdb","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-669315db0393f55824d14fdb: start","job_status":"start","queue_duration_s":2.001035,"scheduling_latency_s":2.001055}1604gitlab # [ 201.156418] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"669315db0393f55824d14fdb","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-669315db0393f55824d14fdb: done: 0.016459 sec","job_status":"done","queue_duration_s":2.001035,"scheduling_latency_s":2.001055,"redis_calls":10,"redis_duration_s":0.001955,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001197,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016459,"completed_at":"2026-08-13T13:16:04.745Z","load_balancing_strategy":"primary","db_duration_s":0.001592,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605gitlab # [ 201.163898] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"50c2a8bbbf7d2b3c189fe73f","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-50c2a8bbbf7d2b3c189fe73f: start","job_status":"start","queue_duration_s":2.018665,"scheduling_latency_s":2.018685}1606gitlab # [ 201.221311] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"50c2a8bbbf7d2b3c189fe73f","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-50c2a8bbbf7d2b3c189fe73f: done: 0.018811 sec","job_status":"done","queue_duration_s":2.018665,"scheduling_latency_s":2.018685,"redis_calls":10,"redis_duration_s":0.002213,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001396,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018811,"completed_at":"2026-08-13T13:16:04.765Z","load_balancing_strategy":"primary","db_duration_s":0.001978,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607gitlab # [ 201.222969] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e04f46070eca31e6b54b4849","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e04f46070eca31e6b54b4849: start","job_status":"start","queue_duration_s":2.03882,"scheduling_latency_s":2.038842}1608gitlab # [ 201.277258] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e04f46070eca31e6b54b4849","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e04f46070eca31e6b54b4849: done: 0.01659 sec","job_status":"done","queue_duration_s":2.03882,"scheduling_latency_s":2.038842,"redis_calls":10,"redis_duration_s":0.002063,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001296,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01659,"completed_at":"2026-08-13T13:16:04.783Z","load_balancing_strategy":"primary","db_duration_s":0.00176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609gitlab # [ 201.281580] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5c75cd495a2ccdc934b1a856","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5c75cd495a2ccdc934b1a856: start","job_status":"start","queue_duration_s":2.057289,"scheduling_latency_s":2.057312}1610gitlab # [ 201.297218] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5c75cd495a2ccdc934b1a856","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5c75cd495a2ccdc934b1a856: done: 0.021964 sec","job_status":"done","queue_duration_s":2.057289,"scheduling_latency_s":2.057312,"redis_calls":10,"redis_duration_s":0.0027,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00142,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00128,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021964,"completed_at":"2026-08-13T13:16:04.807Z","load_balancing_strategy":"primary","db_duration_s":0.00172,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 201.363877] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"86e236e8926467b2c136ceff","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-86e236e8926467b2c136ceff: start","job_status":"start","queue_duration_s":2.081133,"scheduling_latency_s":2.081162}1612gitlab # [ 201.364835] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"86e236e8926467b2c136ceff","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-86e236e8926467b2c136ceff: done: 0.022542 sec","job_status":"done","queue_duration_s":2.081133,"scheduling_latency_s":2.081162,"redis_calls":10,"redis_duration_s":0.0026880000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001132,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001556,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022542,"completed_at":"2026-08-13T13:16:04.831Z","load_balancing_strategy":"primary","db_duration_s":0.002081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 201.418964] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d7c61c9b0709367a3aeea86a","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d7c61c9b0709367a3aeea86a: start","job_status":"start","queue_duration_s":2.105753,"scheduling_latency_s":2.10579}1614gitlab # [ 201.419895] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d7c61c9b0709367a3aeea86a","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d7c61c9b0709367a3aeea86a: done: 0.024165 sec","job_status":"done","queue_duration_s":2.105753,"scheduling_latency_s":2.10579,"redis_calls":10,"redis_duration_s":0.002999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001245,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001754,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024165,"completed_at":"2026-08-13T13:16:04.857Z","load_balancing_strategy":"primary","db_duration_s":0.001908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615gitlab # [ 201.482060] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"68b00c56e9430a462e8b1c19","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-68b00c56e9430a462e8b1c19: start","job_status":"start","queue_duration_s":2.132059,"scheduling_latency_s":2.132096}1616gitlab # [ 201.483062] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"68b00c56e9430a462e8b1c19","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-68b00c56e9430a462e8b1c19: done: 0.027857 sec","job_status":"done","queue_duration_s":2.132059,"scheduling_latency_s":2.132096,"redis_calls":10,"redis_duration_s":0.002772,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001676,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027857,"completed_at":"2026-08-13T13:16:04.887Z","load_balancing_strategy":"primary","db_duration_s":0.003378,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 201.521312] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e8fb6118fff52dfcc1200bde","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e8fb6118fff52dfcc1200bde: start","job_status":"start","queue_duration_s":2.161258,"scheduling_latency_s":2.161283}1618gitlab # [ 201.535547] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e8fb6118fff52dfcc1200bde","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e8fb6118fff52dfcc1200bde: done: 0.021517 sec","job_status":"done","queue_duration_s":2.161258,"scheduling_latency_s":2.161283,"redis_calls":10,"redis_duration_s":0.002543,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001448,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021517,"completed_at":"2026-08-13T13:16:04.910Z","load_balancing_strategy":"primary","db_duration_s":0.001982,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 201.596909] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5dbc7f5ffb1859c53e0f0558","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5dbc7f5ffb1859c53e0f0558: start","job_status":"start","queue_duration_s":2.184863,"scheduling_latency_s":2.184899}1620gitlab # [ 201.597843] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5dbc7f5ffb1859c53e0f0558","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5dbc7f5ffb1859c53e0f0558: done: 0.025672 sec","job_status":"done","queue_duration_s":2.184863,"scheduling_latency_s":2.184899,"redis_calls":10,"redis_duration_s":0.003929,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001585,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002344,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025672,"completed_at":"2026-08-13T13:16:04.938Z","load_balancing_strategy":"primary","db_duration_s":0.001891,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 201.640732] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cca90976bc724dd1b9bf06bc","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cca90976bc724dd1b9bf06bc: start","job_status":"start","queue_duration_s":2.212307,"scheduling_latency_s":2.21234}1622gitlab # [ 201.655688] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cca90976bc724dd1b9bf06bc","created_at":"2026-08-13T13:16:02.647Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-f3a51e3162c04f8e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"3956303c0c9df9859f2ea2367f54c342","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.728Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cca90976bc724dd1b9bf06bc: done: 0.025101 sec","job_status":"done","queue_duration_s":2.212307,"scheduling_latency_s":2.21234,"redis_calls":10,"redis_duration_s":0.0029,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001303,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001597,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025101,"completed_at":"2026-08-13T13:16:04.965Z","load_balancing_strategy":"primary","db_duration_s":0.001875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 201.717397] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.967Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e937d3755299beebe2dabab5","created_at":"2026-08-13T13:16:02.793Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-5f06474a9579402e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d62a5101fba3b6923c5cc6b480b1ca26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.804Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e937d3755299beebe2dabab5: start","job_status":"start","queue_duration_s":2.16337,"scheduling_latency_s":2.163401}1624gitlab # [ 201.718268] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.978Z","message":"No existing merge request to be cleaned up."}1625gitlab # [ 201.719070] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.984Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e937d3755299beebe2dabab5","created_at":"2026-08-13T13:16:02.793Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-5f06474a9579402e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d62a5101fba3b6923c5cc6b480b1ca26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.804Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e937d3755299beebe2dabab5: done: 0.017076 sec","job_status":"done","queue_duration_s":2.16337,"scheduling_latency_s":2.163401,"redis_calls":10,"redis_duration_s":0.001905,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000748,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001157,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017076,"completed_at":"2026-08-13T13:16:04.984Z","load_balancing_strategy":"primary","db_duration_s":0.001841,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1626gitlab # [ 201.763811] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.985Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e151dec31923fbccd9ad5482","created_at":"2026-08-13T13:16:02.793Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-5f06474a9579402e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d62a5101fba3b6923c5cc6b480b1ca26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.804Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e151dec31923fbccd9ad5482: start","job_status":"start","queue_duration_s":2.181688,"scheduling_latency_s":2.181708}1627gitlab # [ 201.778929] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:04.994Z","message":"No existing merge request to be cleaned up."}1628gitlab # [ 201.780803] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.001Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e151dec31923fbccd9ad5482","created_at":"2026-08-13T13:16:02.793Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-5f06474a9579402e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d62a5101fba3b6923c5cc6b480b1ca26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.804Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e151dec31923fbccd9ad5482: done: 0.016271 sec","job_status":"done","queue_duration_s":2.181688,"scheduling_latency_s":2.181708,"redis_calls":10,"redis_duration_s":0.002125,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001272,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016271,"completed_at":"2026-08-13T13:16:05.001Z","load_balancing_strategy":"primary","db_duration_s":0.001253,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629gitlab # [ 201.834684] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.003Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"aa6e3f1238c6939e2307cc54","created_at":"2026-08-13T13:16:02.793Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-5f06474a9579402e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d62a5101fba3b6923c5cc6b480b1ca26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.804Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-aa6e3f1238c6939e2307cc54: start","job_status":"start","queue_duration_s":2.199534,"scheduling_latency_s":2.199557}1630gitlab # [ 201.839569] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.020Z","message":"No existing merge request to be cleaned up."}1631gitlab # [ 201.841737] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.029Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"aa6e3f1238c6939e2307cc54","created_at":"2026-08-13T13:16:02.793Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-5f06474a9579402e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d62a5101fba3b6923c5cc6b480b1ca26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.804Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-aa6e3f1238c6939e2307cc54: done: 0.025619 sec","job_status":"done","queue_duration_s":2.199534,"scheduling_latency_s":2.199557,"redis_calls":10,"redis_duration_s":0.005747,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002404,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003343,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025619,"completed_at":"2026-08-13T13:16:05.029Z","load_balancing_strategy":"primary","db_duration_s":0.001898,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1632gitlab # [ 201.903501] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.031Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"795ba51a51c6b17b1279385c","created_at":"2026-08-13T13:16:02.793Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-5f06474a9579402e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d62a5101fba3b6923c5cc6b480b1ca26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.804Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-795ba51a51c6b17b1279385c: start","job_status":"start","queue_duration_s":2.227229,"scheduling_latency_s":2.227258}1633gitlab # [ 201.904576] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.045Z","message":"No existing merge request to be cleaned up."}1634gitlab # [ 201.904976] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.053Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"795ba51a51c6b17b1279385c","created_at":"2026-08-13T13:16:02.793Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-5f06474a9579402e","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d62a5101fba3b6923c5cc6b480b1ca26","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:02.804Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-795ba51a51c6b17b1279385c: done: 0.022148 sec","job_status":"done","queue_duration_s":2.227229,"scheduling_latency_s":2.227258,"redis_calls":10,"redis_duration_s":0.002599,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001512,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022148,"completed_at":"2026-08-13T13:16:05.053Z","load_balancing_strategy":"primary","db_duration_s":0.001783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635gitlab # [ 201.986067] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1777f393131c5cb16cd90f8","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1777f393131c5cb16cd90f8: start","job_status":"start","queue_duration_s":1.30851,"scheduling_latency_s":1.308538}1636gitlab # [ 201.987060] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1777f393131c5cb16cd90f8","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1777f393131c5cb16cd90f8: done: 0.01817 sec","job_status":"done","queue_duration_s":1.30851,"scheduling_latency_s":1.308538,"redis_calls":13,"redis_duration_s":0.002837,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01817,"completed_at":"2026-08-13T13:16:05.073Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637gitlab # [ 202.009151] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6538eec472ce4f3b53b42a5a","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6538eec472ce4f3b53b42a5a: start","job_status":"start","queue_duration_s":1.32799,"scheduling_latency_s":1.328013}1638gitlab # [ 202.063297] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6538eec472ce4f3b53b42a5a","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6538eec472ce4f3b53b42a5a: done: 0.017156 sec","job_status":"done","queue_duration_s":1.32799,"scheduling_latency_s":1.328013,"redis_calls":13,"redis_duration_s":0.002707,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017156,"completed_at":"2026-08-13T13:16:05.091Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639gitlab # [ 202.069258] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a7c2cba9b39c0708d35817e","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a7c2cba9b39c0708d35817e: start","job_status":"start","queue_duration_s":1.34724,"scheduling_latency_s":1.347275}1640gitlab # [ 202.084072] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a7c2cba9b39c0708d35817e","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a7c2cba9b39c0708d35817e: done: 0.01683 sec","job_status":"done","queue_duration_s":1.34724,"scheduling_latency_s":1.347275,"redis_calls":13,"redis_duration_s":0.002464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001718,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01683,"completed_at":"2026-08-13T13:16:05.110Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641gitlab # [ 202.145167] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0092f923d4ab517595d79e7","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0092f923d4ab517595d79e7: start","job_status":"start","queue_duration_s":1.365421,"scheduling_latency_s":1.365444}1642gitlab # [ 202.146439] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0092f923d4ab517595d79e7","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0092f923d4ab517595d79e7: done: 0.017911 sec","job_status":"done","queue_duration_s":1.365421,"scheduling_latency_s":1.365444,"redis_calls":13,"redis_duration_s":0.003158,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000788,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00237,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017911,"completed_at":"2026-08-13T13:16:05.129Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1643gitlab # [ 202.211046] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad545d982b1f58469a81c709","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad545d982b1f58469a81c709: start","job_status":"start","queue_duration_s":1.384649,"scheduling_latency_s":1.384714}1644gitlab # [ 202.212150] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad545d982b1f58469a81c709","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad545d982b1f58469a81c709: done: 0.016819 sec","job_status":"done","queue_duration_s":1.384649,"scheduling_latency_s":1.384714,"redis_calls":13,"redis_duration_s":0.002956,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002156,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016819,"completed_at":"2026-08-13T13:16:05.147Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1645gitlab # [ 202.278442] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.149Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70b4b08f9e5b24cfa220b94a","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70b4b08f9e5b24cfa220b94a: start","job_status":"start","queue_duration_s":1.402906,"scheduling_latency_s":1.402929}1646gitlab # [ 202.279719] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70b4b08f9e5b24cfa220b94a","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70b4b08f9e5b24cfa220b94a: done: 0.018919 sec","job_status":"done","queue_duration_s":1.402906,"scheduling_latency_s":1.402929,"redis_calls":13,"redis_duration_s":0.0029389999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018919,"completed_at":"2026-08-13T13:16:05.168Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647gitlab # [ 202.337440] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e151070f7c2b485cce92799","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e151070f7c2b485cce92799: start","job_status":"start","queue_duration_s":1.424053,"scheduling_latency_s":1.424077}1648gitlab # [ 202.338689] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e151070f7c2b485cce92799","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e151070f7c2b485cce92799: done: 0.015374 sec","job_status":"done","queue_duration_s":1.424053,"scheduling_latency_s":1.424077,"redis_calls":13,"redis_duration_s":0.002667,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001817,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015374,"completed_at":"2026-08-13T13:16:05.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1649gitlab # [ 202.374927] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68f257e6ca1150e80b8dfa4b","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68f257e6ca1150e80b8dfa4b: start","job_status":"start","queue_duration_s":1.440748,"scheduling_latency_s":1.440768}1650gitlab # [ 202.389359] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68f257e6ca1150e80b8dfa4b","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68f257e6ca1150e80b8dfa4b: done: 0.015739 sec","job_status":"done","queue_duration_s":1.440748,"scheduling_latency_s":1.440768,"redis_calls":13,"redis_duration_s":0.0032170000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001391,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001826,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015739,"completed_at":"2026-08-13T13:16:05.202Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1651gitlab # [ 202.437258] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd39986dbef47676ab517f7a","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd39986dbef47676ab517f7a: start","job_status":"start","queue_duration_s":1.457896,"scheduling_latency_s":1.457916}1652gitlab # [ 202.495440] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd39986dbef47676ab517f7a","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd39986dbef47676ab517f7a: done: 0.018653 sec","job_status":"done","queue_duration_s":1.457896,"scheduling_latency_s":1.457916,"redis_calls":13,"redis_duration_s":0.003284,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002222,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018653,"completed_at":"2026-08-13T13:16:05.222Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1653gitlab # [ 202.497977] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1582873560a9d55b10b8fef9","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1582873560a9d55b10b8fef9: start","job_status":"start","queue_duration_s":1.478708,"scheduling_latency_s":1.47874}1654gitlab # [ 202.512829] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1582873560a9d55b10b8fef9","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1582873560a9d55b10b8fef9: done: 0.01876 sec","job_status":"done","queue_duration_s":1.478708,"scheduling_latency_s":1.47874,"redis_calls":13,"redis_duration_s":0.003059,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002177,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01876,"completed_at":"2026-08-13T13:16:05.243Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1655gitlab # [ 202.572309] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b84334dc20a69487782c1404","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b84334dc20a69487782c1404: start","job_status":"start","queue_duration_s":1.499395,"scheduling_latency_s":1.499436}1656gitlab # [ 202.573459] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b84334dc20a69487782c1404","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b84334dc20a69487782c1404: done: 0.019282 sec","job_status":"done","queue_duration_s":1.499395,"scheduling_latency_s":1.499436,"redis_calls":13,"redis_duration_s":0.0026639999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00081,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001854,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019282,"completed_at":"2026-08-13T13:16:05.265Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1657gitlab # [ 202.667872] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3260d400c3af34f06e157cbb","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3260d400c3af34f06e157cbb: start","job_status":"start","queue_duration_s":1.519974,"scheduling_latency_s":1.519996}1658gitlab # [ 202.668944] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3260d400c3af34f06e157cbb","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3260d400c3af34f06e157cbb: done: 0.017304 sec","job_status":"done","queue_duration_s":1.519974,"scheduling_latency_s":1.519996,"redis_calls":13,"redis_duration_s":0.002591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001748,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017304,"completed_at":"2026-08-13T13:16:05.283Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1659gitlab # [ 202.728326] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"253a2563906264ec14591c98","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-253a2563906264ec14591c98: start","job_status":"start","queue_duration_s":1.53977,"scheduling_latency_s":1.539806}1660gitlab # [ 202.729647] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"253a2563906264ec14591c98","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-253a2563906264ec14591c98: done: 0.018704 sec","job_status":"done","queue_duration_s":1.53977,"scheduling_latency_s":1.539806,"redis_calls":13,"redis_duration_s":0.0027990000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000789,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00201,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018704,"completed_at":"2026-08-13T13:16:05.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1661gitlab # [ 202.745457] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bee3a31c940c510244c1da67","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bee3a31c940c510244c1da67: start","job_status":"start","queue_duration_s":1.559742,"scheduling_latency_s":1.559764}1662gitlab # [ 202.798233] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bee3a31c940c510244c1da67","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bee3a31c940c510244c1da67: done: 0.014238 sec","job_status":"done","queue_duration_s":1.559742,"scheduling_latency_s":1.559764,"redis_calls":13,"redis_duration_s":0.002565,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000754,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014238,"completed_at":"2026-08-13T13:16:05.320Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1663gitlab # [ 202.855936] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ccf56ce562fa9341c105a0f","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ccf56ce562fa9341c105a0f: start","job_status":"start","queue_duration_s":1.575296,"scheduling_latency_s":1.575321}1664gitlab # [ 202.856958] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ccf56ce562fa9341c105a0f","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ccf56ce562fa9341c105a0f: done: 0.017349 sec","job_status":"done","queue_duration_s":1.575296,"scheduling_latency_s":1.575321,"redis_calls":13,"redis_duration_s":0.002929,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017349,"completed_at":"2026-08-13T13:16:05.339Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1665gitlab # [ 202.910897] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8355332f65113fe01c948562","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8355332f65113fe01c948562: start","job_status":"start","queue_duration_s":1.594182,"scheduling_latency_s":1.594205}1666gitlab # [ 202.911897] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8355332f65113fe01c948562","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8355332f65113fe01c948562: done: 0.013996 sec","job_status":"done","queue_duration_s":1.594182,"scheduling_latency_s":1.594205,"redis_calls":13,"redis_duration_s":0.002399,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000785,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001614,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009513,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013996,"completed_at":"2026-08-13T13:16:05.354Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1667gitlab # [ 202.928270] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d49bbd82c3c4a524b86d3027","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d49bbd82c3c4a524b86d3027: start","job_status":"start","queue_duration_s":1.609641,"scheduling_latency_s":1.609659}1668gitlab # [ 202.943613] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d49bbd82c3c4a524b86d3027","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d49bbd82c3c4a524b86d3027: done: 0.013784 sec","job_status":"done","queue_duration_s":1.609641,"scheduling_latency_s":1.609659,"redis_calls":13,"redis_duration_s":0.0025640000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001706,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013784,"completed_at":"2026-08-13T13:16:05.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1669gitlab # [ 203.036891] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"998ccbfe9cfe25667af4937a","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-998ccbfe9cfe25667af4937a: start","job_status":"start","queue_duration_s":1.624741,"scheduling_latency_s":1.624759}1670gitlab # [ 203.038145] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"998ccbfe9cfe25667af4937a","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-998ccbfe9cfe25667af4937a: done: 0.015569 sec","job_status":"done","queue_duration_s":1.624741,"scheduling_latency_s":1.624759,"redis_calls":13,"redis_duration_s":0.002928,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015569,"completed_at":"2026-08-13T13:16:05.386Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1671gitlab # [ 203.051109] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc1fd0cca2dd64ed13a7634b","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc1fd0cca2dd64ed13a7634b: start","job_status":"start","queue_duration_s":1.641634,"scheduling_latency_s":1.641657}1672gitlab # [ 203.065889] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc1fd0cca2dd64ed13a7634b","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc1fd0cca2dd64ed13a7634b: done: 0.01436 sec","job_status":"done","queue_duration_s":1.641634,"scheduling_latency_s":1.641657,"redis_calls":13,"redis_duration_s":0.002646,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001851,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01436,"completed_at":"2026-08-13T13:16:05.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1673gitlab # [ 203.145327] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99fbb2495084eecdcd15f4b4","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99fbb2495084eecdcd15f4b4: start","job_status":"start","queue_duration_s":1.657204,"scheduling_latency_s":1.657221}1674gitlab # [ 203.146894] setup-gitlab-start[2508]: W, [2026-08-13T13:16:08.756330 #2508] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1675gitlab # [ 203.147972] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99fbb2495084eecdcd15f4b4","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99fbb2495084eecdcd15f4b4: done: 0.019648 sec","job_status":"done","queue_duration_s":1.657204,"scheduling_latency_s":1.657221,"redis_calls":13,"redis_duration_s":0.0049110000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002271,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00264,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019648,"completed_at":"2026-08-13T13:16:05.423Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1676gitlab # [ 203.176958] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7578df29f31381b2f4cedaa7","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7578df29f31381b2f4cedaa7: start","job_status":"start","queue_duration_s":1.678507,"scheduling_latency_s":1.678532}1677gitlab # [ 203.235331] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7578df29f31381b2f4cedaa7","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7578df29f31381b2f4cedaa7: done: 0.015254 sec","job_status":"done","queue_duration_s":1.678507,"scheduling_latency_s":1.678532,"redis_calls":13,"redis_duration_s":0.002764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000839,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015254,"completed_at":"2026-08-13T13:16:05.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1678gitlab # [ 203.237511] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e45848418030499f3962531f","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e45848418030499f3962531f: start","job_status":"start","queue_duration_s":1.695268,"scheduling_latency_s":1.695296}1679gitlab # [ 203.252492] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e45848418030499f3962531f","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e45848418030499f3962531f: done: 0.016374 sec","job_status":"done","queue_duration_s":1.695268,"scheduling_latency_s":1.695296,"redis_calls":13,"redis_duration_s":0.002953,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001076,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016374,"completed_at":"2026-08-13T13:16:05.458Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1680gitlab # [ 203.344985] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"516d2dc175055f12b8bea898","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-516d2dc175055f12b8bea898: start","job_status":"start","queue_duration_s":1.71378,"scheduling_latency_s":1.713811}1681gitlab # [ 203.346067] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"516d2dc175055f12b8bea898","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-516d2dc175055f12b8bea898: done: 0.016749 sec","job_status":"done","queue_duration_s":1.71378,"scheduling_latency_s":1.713811,"redis_calls":13,"redis_duration_s":0.002805,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000856,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016749,"completed_at":"2026-08-13T13:16:05.476Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1682gitlab # [ 203.361055] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18d0338f6d7ce4eae3dafe50","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18d0338f6d7ce4eae3dafe50: start","job_status":"start","queue_duration_s":1.73193,"scheduling_latency_s":1.73195}1683gitlab # [ 203.376121] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18d0338f6d7ce4eae3dafe50","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18d0338f6d7ce4eae3dafe50: done: 0.014507 sec","job_status":"done","queue_duration_s":1.73193,"scheduling_latency_s":1.73195,"redis_calls":13,"redis_duration_s":0.002608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001724,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014507,"completed_at":"2026-08-13T13:16:05.492Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1684gitlab # [ 203.438976] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74f97a3e26ad331d74985025","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74f97a3e26ad331d74985025: start","job_status":"start","queue_duration_s":1.747774,"scheduling_latency_s":1.747799}1685gitlab # [ 203.440255] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74f97a3e26ad331d74985025","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74f97a3e26ad331d74985025: done: 0.017449 sec","job_status":"done","queue_duration_s":1.747774,"scheduling_latency_s":1.747799,"redis_calls":13,"redis_duration_s":0.002601,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001779,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017449,"completed_at":"2026-08-13T13:16:05.511Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1686gitlab # [ 203.500820] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c055800396c206c62b6104ca","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c055800396c206c62b6104ca: start","job_status":"start","queue_duration_s":1.766541,"scheduling_latency_s":1.766562}1687gitlab # [ 203.508718] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c055800396c206c62b6104ca","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c055800396c206c62b6104ca: done: 0.016578 sec","job_status":"done","queue_duration_s":1.766541,"scheduling_latency_s":1.766562,"redis_calls":13,"redis_duration_s":0.002691,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000838,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001853,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016578,"completed_at":"2026-08-13T13:16:05.529Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1688gitlab # [ 203.567772] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0589d9166fe1a6b46f2adfc","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0589d9166fe1a6b46f2adfc: start","job_status":"start","queue_duration_s":1.784667,"scheduling_latency_s":1.78472}1689gitlab # [ 203.571202] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0589d9166fe1a6b46f2adfc","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0589d9166fe1a6b46f2adfc: done: 0.018821 sec","job_status":"done","queue_duration_s":1.784667,"scheduling_latency_s":1.78472,"redis_calls":13,"redis_duration_s":0.004217,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00331,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018821,"completed_at":"2026-08-13T13:16:05.549Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1690gitlab # [ 203.618268] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"935d4526ad59defa28f43e0c","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-935d4526ad59defa28f43e0c: start","job_status":"start","queue_duration_s":1.805093,"scheduling_latency_s":1.805115}1691gitlab # [ 203.633399] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"935d4526ad59defa28f43e0c","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-935d4526ad59defa28f43e0c: done: 0.014098 sec","job_status":"done","queue_duration_s":1.805093,"scheduling_latency_s":1.805115,"redis_calls":13,"redis_duration_s":0.002569,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001783,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014098,"completed_at":"2026-08-13T13:16:05.565Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1692gitlab # [ 203.699258] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dbbf26386a6dfd633e0c2e8","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dbbf26386a6dfd633e0c2e8: start","job_status":"start","queue_duration_s":1.820398,"scheduling_latency_s":1.820416}1693gitlab # [ 203.700259] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dbbf26386a6dfd633e0c2e8","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dbbf26386a6dfd633e0c2e8: done: 0.020455 sec","job_status":"done","queue_duration_s":1.820398,"scheduling_latency_s":1.820416,"redis_calls":13,"redis_duration_s":0.005489999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004617,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020455,"completed_at":"2026-08-13T13:16:05.587Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1694gitlab # [ 203.767968] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad2ee495c32a1db1f2d10811","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad2ee495c32a1db1f2d10811: start","job_status":"start","queue_duration_s":1.842227,"scheduling_latency_s":1.842251}1695gitlab # [ 203.768979] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad2ee495c32a1db1f2d10811","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad2ee495c32a1db1f2d10811: done: 0.014827 sec","job_status":"done","queue_duration_s":1.842227,"scheduling_latency_s":1.842251,"redis_calls":13,"redis_duration_s":0.0023,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001609,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014827,"completed_at":"2026-08-13T13:16:05.603Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1696gitlab # [ 203.835783] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68a109cf38c744151927f78c","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68a109cf38c744151927f78c: start","job_status":"start","queue_duration_s":1.858537,"scheduling_latency_s":1.858557}1697gitlab # [ 203.836797] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68a109cf38c744151927f78c","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68a109cf38c744151927f78c: done: 0.021145 sec","job_status":"done","queue_duration_s":1.858537,"scheduling_latency_s":1.858557,"redis_calls":13,"redis_duration_s":0.003007,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021145,"completed_at":"2026-08-13T13:16:05.626Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1698gitlab # [ 203.908304] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5915c4ac934f115d84625e87","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5915c4ac934f115d84625e87: start","job_status":"start","queue_duration_s":1.881191,"scheduling_latency_s":1.881215}1699gitlab # [ 203.909311] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5915c4ac934f115d84625e87","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5915c4ac934f115d84625e87: done: 0.014843 sec","job_status":"done","queue_duration_s":1.881191,"scheduling_latency_s":1.881215,"redis_calls":13,"redis_duration_s":0.002729,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014843,"completed_at":"2026-08-13T13:16:05.642Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1700gitlab # [ 203.920274] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0876910babf884cb56f39bb5","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0876910babf884cb56f39bb5: start","job_status":"start","queue_duration_s":1.897335,"scheduling_latency_s":1.897353}1701gitlab # [ 203.936109] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0876910babf884cb56f39bb5","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0876910babf884cb56f39bb5: done: 0.017236 sec","job_status":"done","queue_duration_s":1.897335,"scheduling_latency_s":1.897353,"redis_calls":13,"redis_duration_s":0.0037619999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000996,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002766,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017236,"completed_at":"2026-08-13T13:16:05.660Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1702gitlab # [ 204.012793] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41db62f3a754bcdb2e36eb93","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41db62f3a754bcdb2e36eb93: start","job_status":"start","queue_duration_s":1.916452,"scheduling_latency_s":1.916481}1703gitlab # [ 204.013812] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41db62f3a754bcdb2e36eb93","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41db62f3a754bcdb2e36eb93: done: 0.022466 sec","job_status":"done","queue_duration_s":1.916452,"scheduling_latency_s":1.916481,"redis_calls":13,"redis_duration_s":0.004106,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001389,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002717,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022466,"completed_at":"2026-08-13T13:16:05.685Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1704gitlab # [ 204.043683] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9d4fe7ac954b9daef5deb6a","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9d4fe7ac954b9daef5deb6a: start","job_status":"start","queue_duration_s":1.941162,"scheduling_latency_s":1.941201}1705gitlab # [ 204.058418] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9d4fe7ac954b9daef5deb6a","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9d4fe7ac954b9daef5deb6a: done: 0.022753 sec","job_status":"done","queue_duration_s":1.941162,"scheduling_latency_s":1.941201,"redis_calls":13,"redis_duration_s":0.0037689999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00159,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022753,"completed_at":"2026-08-13T13:16:05.710Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1706gitlab # [ 204.127099] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed4de827982d16dd3796b917","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed4de827982d16dd3796b917: start","job_status":"start","queue_duration_s":1.965534,"scheduling_latency_s":1.965561}1707gitlab # [ 204.128103] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed4de827982d16dd3796b917","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed4de827982d16dd3796b917: done: 0.01494 sec","job_status":"done","queue_duration_s":1.965534,"scheduling_latency_s":1.965561,"redis_calls":13,"redis_duration_s":0.002503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000806,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001697,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01494,"completed_at":"2026-08-13T13:16:05.726Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1708gitlab # [ 204.192102] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"191cc8f8be621a055742aee4","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-191cc8f8be621a055742aee4: start","job_status":"start","queue_duration_s":1.981721,"scheduling_latency_s":1.98174}1709gitlab # [ 204.193304] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"191cc8f8be621a055742aee4","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-191cc8f8be621a055742aee4: done: 0.014109 sec","job_status":"done","queue_duration_s":1.981721,"scheduling_latency_s":1.98174,"redis_calls":13,"redis_duration_s":0.0025180000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000774,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001744,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009342,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014109,"completed_at":"2026-08-13T13:16:05.742Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1710gitlab # [ 204.245161] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0175aec1ec0c83df94e7dbc","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0175aec1ec0c83df94e7dbc: start","job_status":"start","queue_duration_s":1.997407,"scheduling_latency_s":1.997433}1711gitlab # [ 204.246427] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0175aec1ec0c83df94e7dbc","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0175aec1ec0c83df94e7dbc: done: 0.016294 sec","job_status":"done","queue_duration_s":1.997407,"scheduling_latency_s":1.997433,"redis_calls":13,"redis_duration_s":0.002793,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016294,"completed_at":"2026-08-13T13:16:05.760Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1712gitlab # [ 204.333880] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bef3d8fb59c8eaa60256567","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bef3d8fb59c8eaa60256567: start","job_status":"start","queue_duration_s":2.01512,"scheduling_latency_s":2.015141}1713gitlab # [ 204.334994] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bef3d8fb59c8eaa60256567","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bef3d8fb59c8eaa60256567: done: 0.01492 sec","job_status":"done","queue_duration_s":2.01512,"scheduling_latency_s":2.015141,"redis_calls":13,"redis_duration_s":0.002617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000827,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01492,"completed_at":"2026-08-13T13:16:05.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1714gitlab # [ 204.345310] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55953f91e7fe4b09b8b2fe6d","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55953f91e7fe4b09b8b2fe6d: start","job_status":"start","queue_duration_s":2.03138,"scheduling_latency_s":2.031399}1715gitlab # [ 204.401509] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55953f91e7fe4b09b8b2fe6d","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55953f91e7fe4b09b8b2fe6d: done: 0.016374 sec","job_status":"done","queue_duration_s":2.03138,"scheduling_latency_s":2.031399,"redis_calls":13,"redis_duration_s":0.0027919999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016374,"completed_at":"2026-08-13T13:16:05.794Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1716gitlab # [ 204.405863] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdadbaa1e0bf0fb9fbf76d53","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdadbaa1e0bf0fb9fbf76d53: start","job_status":"start","queue_duration_s":2.049745,"scheduling_latency_s":2.049784}1717gitlab # [ 204.420474] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdadbaa1e0bf0fb9fbf76d53","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdadbaa1e0bf0fb9fbf76d53: done: 0.019708 sec","job_status":"done","queue_duration_s":2.049745,"scheduling_latency_s":2.049784,"redis_calls":13,"redis_duration_s":0.003116,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019708,"completed_at":"2026-08-13T13:16:05.815Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1718gitlab # [ 204.471817] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"903493e1067bd9c1ccad60b1","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-903493e1067bd9c1ccad60b1: start","job_status":"start","queue_duration_s":2.07148,"scheduling_latency_s":2.071513}1719gitlab # [ 204.534990] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"903493e1067bd9c1ccad60b1","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-903493e1067bd9c1ccad60b1: done: 0.017473 sec","job_status":"done","queue_duration_s":2.07148,"scheduling_latency_s":2.071513,"redis_calls":13,"redis_duration_s":0.002526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001746,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017473,"completed_at":"2026-08-13T13:16:05.835Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1720gitlab # [ 204.536338] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a983783ef60c7825a093be2","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a983783ef60c7825a093be2: start","job_status":"start","queue_duration_s":2.090425,"scheduling_latency_s":2.090447}1721gitlab # [ 204.546667] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a983783ef60c7825a093be2","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a983783ef60c7825a093be2: done: 0.014227 sec","job_status":"done","queue_duration_s":2.090425,"scheduling_latency_s":2.090447,"redis_calls":13,"redis_duration_s":0.002203,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001509,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014227,"completed_at":"2026-08-13T13:16:05.851Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1722gitlab # [ 204.592418] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59b4c2983ca71733ef2a1fe4","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59b4c2983ca71733ef2a1fe4: start","job_status":"start","queue_duration_s":2.105972,"scheduling_latency_s":2.105991}1723gitlab # [ 204.650771] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59b4c2983ca71733ef2a1fe4","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59b4c2983ca71733ef2a1fe4: done: 0.013698 sec","job_status":"done","queue_duration_s":2.105972,"scheduling_latency_s":2.105991,"redis_calls":13,"redis_duration_s":0.0021190000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001497,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013698,"completed_at":"2026-08-13T13:16:05.866Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1724gitlab # [ 204.657644] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47a6a5958e338df9533d7644","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47a6a5958e338df9533d7644: start","job_status":"start","queue_duration_s":2.120875,"scheduling_latency_s":2.120896}1725gitlab # [ 204.672286] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47a6a5958e338df9533d7644","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47a6a5958e338df9533d7644: done: 0.014623 sec","job_status":"done","queue_duration_s":2.120875,"scheduling_latency_s":2.120896,"redis_calls":13,"redis_duration_s":0.002442,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001685,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014623,"completed_at":"2026-08-13T13:16:05.881Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1726gitlab # [ 204.726716] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9f5c5055cb665351790e8d5","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9f5c5055cb665351790e8d5: start","job_status":"start","queue_duration_s":2.136767,"scheduling_latency_s":2.136787}1727gitlab # [ 204.781880] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9f5c5055cb665351790e8d5","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9f5c5055cb665351790e8d5: done: 0.014436 sec","job_status":"done","queue_duration_s":2.136767,"scheduling_latency_s":2.136787,"redis_calls":13,"redis_duration_s":0.002405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000729,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001676,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014436,"completed_at":"2026-08-13T13:16:05.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1728gitlab # [ 204.783323] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a956c5778a59e3eae4746aa7","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a956c5778a59e3eae4746aa7: start","job_status":"start","queue_duration_s":2.152388,"scheduling_latency_s":2.152408}1729gitlab # [ 204.841142] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a956c5778a59e3eae4746aa7","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a956c5778a59e3eae4746aa7: done: 0.01537 sec","job_status":"done","queue_duration_s":2.152388,"scheduling_latency_s":2.152408,"redis_calls":13,"redis_duration_s":0.0022370000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000774,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001463,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01537,"completed_at":"2026-08-13T13:16:05.914Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1730gitlab # [ 204.843269] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59cdb43b792ff5aa1c281a3d","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59cdb43b792ff5aa1c281a3d: start","job_status":"start","queue_duration_s":2.169515,"scheduling_latency_s":2.16954}1731gitlab # [ 204.858393] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59cdb43b792ff5aa1c281a3d","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59cdb43b792ff5aa1c281a3d: done: 0.020012 sec","job_status":"done","queue_duration_s":2.169515,"scheduling_latency_s":2.16954,"redis_calls":13,"redis_duration_s":0.003098,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001003,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020012,"completed_at":"2026-08-13T13:16:05.935Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1732gitlab # [ 204.915469] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d50a265e242965e26b2049ba","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d50a265e242965e26b2049ba: start","job_status":"start","queue_duration_s":2.191257,"scheduling_latency_s":2.191292}1733gitlab # [ 204.918185] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d50a265e242965e26b2049ba","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d50a265e242965e26b2049ba: done: 0.024691 sec","job_status":"done","queue_duration_s":2.191257,"scheduling_latency_s":2.191292,"redis_calls":13,"redis_duration_s":0.006608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004269,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002339,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024691,"completed_at":"2026-08-13T13:16:05.962Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1734gitlab # [ 204.971467] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8201d10892a7bdffce10d68","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8201d10892a7bdffce10d68: start","job_status":"start","queue_duration_s":2.217744,"scheduling_latency_s":2.217769}1735gitlab # [ 204.978050] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:05.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8201d10892a7bdffce10d68","created_at":"2026-08-13T13:16:03.674Z","trace_propagation_headers":{"sentry-trace":"585cf8c525a343a195f20b37e14ab36b-e8770a16fd854a2b","baggage":"sentry-trace_id=585cf8c525a343a195f20b37e14ab36b,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"eb48560e9dbbf008e45042b51943cf00","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:03.746Z","job_size_bytes":2,"pid":1772,"sidekiq_tid":"mah0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8201d10892a7bdffce10d68: done: 0.018956 sec","job_status":"done","queue_duration_s":2.217744,"scheduling_latency_s":2.217769,"redis_calls":13,"redis_duration_s":0.0026620000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000848,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001814,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018956,"completed_at":"2026-08-13T13:16:05.983Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1736gitlab # [ 205.312957] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 8369387896 wd_nsec: 83693841791737gitlab # [ 231.363200] postgres[2777]: [2777] ERROR: relation "table_without_models" does not exist1738gitlab # [ 231.363453] postgres[2777]: [2777] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1739gitlab # [ 235.289326] runuser[2507]: pam_unix(runuser:session): session closed for user gitlab1740gitlab # [ 235.290175] setup-gitlab-start[2485]: + systemctl restart gitlab-sidekiq.service1741gitlab # [ 235.310700] systemd[1]: Stopping gitlab-sidekiq.service...1742gitlab # [ 235.311653] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:41.009Z","message":"Shutting down"}1743gitlab # [ 235.312318] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:41.009Z","message":"Scheduler exiting..."}1744gitlab # [ 235.313563] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:41.010Z","message":"Terminating quiet threads for default capsule"}1745gitlab # [ 235.314316] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:41.010Z","message":"Scheduler exiting..."}1746gitlab # [ 235.814096] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:41.511Z","message":"Bye!"}1747gitlab # [ 235.826825] sidekiq-cluster[1772]: {"severity":"INFO","time":"2026-08-13T13:16:41.524Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1772,"worker_id":"sidekiq_0","memwd_rss_bytes":941453312,"retry":0}1748gitlab # [ 237.519492] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1749gitlab # [ 237.519992] systemd[1]: Stopped gitlab-sidekiq.service.1750gitlab # [ 237.521088] systemd[1]: gitlab-sidekiq.service: Consumed 1min 19.159s CPU time over 2min 29.209s wall clock time, 958.1M memory peak, 4.4M read from disk.1751gitlab # [ 237.527700] systemd[1]: Started gitlab-sidekiq.service.1752gitlab # [ 237.528868] setup-gitlab-start[2485]: + mkdir -p /var/lib/secrets1753gitlab # [ 237.529802] setup-gitlab-start[2485]: + echo nixbot-test-token-of-20-chars1754gitlab # [ 237.530305] setup-gitlab-start[2485]: + chmod 644 /var/lib/secrets/gitlab-token1755gitlab # [ 237.530975] setup-gitlab-start[2485]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1756gitlab # [ 238.265571] gitaly[914]: time="2026-08-13T13:16:43.963Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:16:53.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:43.962" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1757gitlab # [ 238.266575] gitaly[914]: time="2026-08-13T13:16:43.963Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:16:53.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:43.962" grpc.time_ms=0.53 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1758gitlab # [ 238.395878] gitaly[914]: time="2026-08-13T13:16:44.093Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:16:54.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.093" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1759gitlab # [ 238.396519] gitaly[914]: time="2026-08-13T13:16:44.094Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:16:54.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.093" grpc.time_ms=0.39 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1760gitlab # [ 238.445170] gitaly[914]: time="2026-08-13T13:16:44.143Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH diskcache=289441bf-4608-46c6-8812-68c04dd27324 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-13T13:16:54.013" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.104" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1761gitlab # [ 238.445779] gitaly[914]: time="2026-08-13T13:16:44.143Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1575 command.oublock=32 command.real_time_ms=25 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-13T13:16:54.013" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.104" grpc.time_ms=39.033 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762gitlab # [ 238.477362] gitaly[914]: time="2026-08-13T13:16:44.175Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:16:54.084" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.174" pid=914 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1763gitlab # [ 238.478126] gitaly[914]: time="2026-08-13T13:16:44.175Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:16:54.084" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.174" grpc.time_ms=0.614 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764gitlab # [ 238.513233] gitaly[914]: time="2026-08-13T13:16:44.211Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T13:16:54.114" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.205" grpc.time_ms=5.476 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765gitlab # [ 238.598160] gitaly[914]: time="2026-08-13T13:16:44.296Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:16:54.205" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.295" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 238.612709] gitaly[914]: time="2026-08-13T13:16:44.296Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:16:54.205" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.295" grpc.time_ms=0.249 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 238.626811] gitaly[914]: time="2026-08-13T13:16:44.324Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH diskcache=05b0c21b-a0b4-40d3-a217-41a721c6f331 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-13T13:16:54.208" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.299" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 238.628884] gitaly[914]: time="2026-08-13T13:16:44.324Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1574 command.oublock=32 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-13T13:16:54.208" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.299" grpc.time_ms=25.195 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 238.635587] gitaly[914]: time="2026-08-13T13:16:44.333Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:16:54.242" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.333" pid=914 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1770gitlab # [ 238.637545] gitaly[914]: time="2026-08-13T13:16:44.335Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:16:54.242" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.333" grpc.time_ms=1.646 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 238.644411] gitaly[914]: time="2026-08-13T13:16:44.342Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T13:16:54.248" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.338" grpc.time_ms=3.751 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772gitlab # [ 238.671295] gitaly[914]: time="2026-08-13T13:16:44.369Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:16:54.278" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.368" grpc.time_ms=0.211 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 238.680551] gitaly[914]: time="2026-08-13T13:16:44.378Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-13T13:16:54.287" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.377" grpc.time_ms=0.271 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1774gitlab # [ 239.246573] gitaly[914]: time="2026-08-13T13:16:44.944Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM94V3FJBNSSP5ZZXRCXGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T13:16:54.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:44.937" grpc.time_ms=6.719 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab # [ 239.606546] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:45 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 20681776gitlab # [ 239.609699] setup-gitlab-start[2485]: + mkdir -p /tmp/test-flake1777gitlab # [ 239.611315] setup-gitlab-start[2485]: + cd /tmp/test-flake1778gitlab # [ 239.612606] setup-gitlab-start[2485]: + git init -b master1779gitlab # [ 239.625896] setup-gitlab-start[2862]: Initialized empty Git repository in /tmp/test-flake/.git/1780gitlab # [ 239.627892] setup-gitlab-start[2485]: + git config user.name test1781gitlab # [ 239.629308] setup-gitlab-start[2485]: + git config user.email test@example.com1782gitlab # [ 239.630858] setup-gitlab-start[2485]: + cat1783gitlab # [ 239.631748] setup-gitlab-start[2485]: + git add flake.nix1784gitlab # [ 239.632885] setup-gitlab-start[2485]: + git commit -m 'initial commit'1785gitlab # [ 239.635844] setup-gitlab-start[2867]: [master (root-commit) 8f8c0a6] initial commit1786gitlab # [ 239.636753] setup-gitlab-start[2867]: 1 file changed, 10 insertions(+)1787gitlab # [ 239.637742] setup-gitlab-start[2867]: create mode 100644 flake.nix1788gitlab # [ 239.638954] setup-gitlab-start[2485]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1789gitlab # [ 239.643152] setup-gitlab-start[2485]: + git push -u origin master1790gitlab # [ 239.688144] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:45 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 281791gitlab # [ 239.787431] gitaly[914]: time="2026-08-13T13:16:45.484Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZXM96YDJKEB8KW5VWJSJ9TS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:45.479" grpc.time_ms=5.614 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1792gitlab # [ 239.789048] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:45 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 961793gitlab # [ 239.997209] gitaly[914]: time="2026-08-13T13:16:45.695Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T13:16:55.000" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:45.690" grpc.time_ms=4.073 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1794gitlab # [ 240.025148] gitaly[914]: time="2026-08-13T13:16:45.723Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-13T13:17:15.017" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-13T13:16:45.717" grpc.time_ms=4.981 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1795gitlab # [ 240.062258] gitaly[914]: time="2026-08-13T13:16:45.760Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZXM9726EH11QY5THTME2M62 duration_ms=137ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/allowed"1796gitlab # [ 240.089921] gitaly[914]: time="2026-08-13T13:16:45.787Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZXM9726EH11QY5THTME2M62 duration_ms=26ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/pre_receive"1797gitlab # [ 240.090690] gitaly[914]: time="2026-08-13T13:16:45.788Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5308 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:16:45.621" grpc.time_ms=166.874 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1798gitlab # [ 240.132709] gitaly[914]: time="2026-08-13T13:16:45.830Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:16:45.829" grpc.time_ms=0.684 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1799gitlab # [ 240.171652] gitaly[914]: time="2026-08-13T13:16:45.869Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4777 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:16:45.869" grpc.time_ms=0.486 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1800gitlab # [ 240.203475] gitaly[914]: time="2026-08-13T13:16:45.901Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:16:45.900" grpc.time_ms=0.469 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1801gitlab # [ 240.286466] gitaly[914]: time="2026-08-13T13:16:45.984Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T13:16:55.019" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:45.979" grpc.time_ms=4.337 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1802gitlab # [ 240.300667] gitaly[914]: time="2026-08-13T13:16:45.998Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1564 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-13T13:16:55.029" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:16:45.989" grpc.time_ms=8.581 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 240.311653] gitaly[914]: time="2026-08-13T13:16:46.009Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZXM9726EH11QY5THTME2M62 duration_ms=72ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/post_receive"1804gitlab # [ 240.312723] gitaly[914]: time="2026-08-13T13:16:46.009Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4802 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:16:45.936" grpc.time_ms=73.191 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1805gitlab # [ 240.341647] gitaly[914]: time="2026-08-13T13:16:46.039Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 diskcache=b4477163-085e-49a1-a41e-8494a1205a0f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:45.586" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1806gitlab # [ 240.354054] gitaly[914]: time="2026-08-13T13:16:46.039Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=139 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=876544 command.minflt=13681 command.oublock=32 command.real_time_ms=447 command.spawn_token_fork_ms=0 command.system_time_ms=86 command.user_time_ms=53 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:45.586" grpc.time_ms=453.084 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1807gitlab # [ 240.370081] setup-gitlab-start[2871]: To http://gitlab/root/test-flake.git1808gitlab # [ 240.371340] setup-gitlab-start[2871]: * [new branch] master -> master1809gitlab # [ 240.372584] setup-gitlab-start[2871]: branch 'master' set up to track 'origin/master'.1810gitlab # [ 240.374041] gitlab-workhorse[822]: time="2026-08-13T13:16:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521811gitlab # [ 240.376426] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:46 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5301812gitlab # [ 240.379067] systemd[1]: Finished setup-gitlab.service.1813gitlab # [ 240.380192] systemd[1]: Starting nixbot CI service...1814gitlab: (finished: waiting for unit setup-gitlab.service, in 242.20 seconds)1815gitlab: waiting for unit nixbot.service1816gitlab # [ 241.438445] nixbot[2948]: {"ts": "2026-08-13T13:16:47.135Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1817gitlab # [ 241.457452] nixbot[2948]: {"ts": "2026-08-13T13:16:47.155Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1818gitlab # [ 241.471706] nixbot[2948]: {"ts": "2026-08-13T13:16:47.169Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1819gitlab # [ 241.475318] nixbot[2948]: {"ts": "2026-08-13T13:16:47.173Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1820gitlab # [ 241.478534] nixbot[2948]: {"ts": "2026-08-13T13:16:47.176Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1821gitlab # [ 241.482753] nixbot[2948]: {"ts": "2026-08-13T13:16:47.180Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1822gitlab # [ 241.485893] nixbot[2948]: {"ts": "2026-08-13T13:16:47.183Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1823gitlab # [ 241.490741] nixbot[2948]: {"ts": "2026-08-13T13:16:47.188Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1824gitlab # [ 241.499733] nixbot[2948]: {"ts": "2026-08-13T13:16:47.197Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1825gitlab # [ 241.506128] nixbot[2948]: {"ts": "2026-08-13T13:16:47.203Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1826gitlab # [ 241.510380] nixbot[2948]: {"ts": "2026-08-13T13:16:47.208Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1827gitlab # [ 241.515228] nixbot[2948]: {"ts": "2026-08-13T13:16:47.213Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1828gitlab # [ 241.518877] nixbot[2948]: {"ts": "2026-08-13T13:16:47.215Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1829gitlab # [ 241.522355] nixbot[2948]: {"ts": "2026-08-13T13:16:47.217Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1830gitlab # [ 241.526112] nixbot[2948]: {"ts": "2026-08-13T13:16:47.220Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1831gitlab # [ 241.526554] nixbot[2948]: {"ts": "2026-08-13T13:16:47.222Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1832gitlab # [ 241.527944] nixbot[2948]: {"ts": "2026-08-13T13:16:47.224Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1833gitlab # [ 241.537791] nixbot[2948]: {"ts": "2026-08-13T13:16:47.235Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1834gitlab # [ 241.543820] nixbot[2948]: {"ts": "2026-08-13T13:16:47.241Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1835gitlab # [ 241.547899] nixbot[2948]: {"ts": "2026-08-13T13:16:47.245Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1836gitlab # [ 241.552123] nixbot[2948]: {"ts": "2026-08-13T13:16:47.250Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1837gitlab # [ 241.558653] nixbot[2948]: {"ts": "2026-08-13T13:16:47.256Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1838gitlab # [ 241.562888] nixbot[2948]: {"ts": "2026-08-13T13:16:47.260Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1839gitlab # [ 241.567505] nixbot[2948]: {"ts": "2026-08-13T13:16:47.265Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1840gitlab # [ 241.570483] nixbot[2948]: {"ts": "2026-08-13T13:16:47.266Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1841gitlab # [ 241.908819] nixbot[2948]: INFO: Started server process [2948]1842gitlab # [ 241.909369] nixbot[2948]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1843gitlab # [ 241.929650] nixbot[2948]: INFO: ::ffff:127.0.0.1:50354 - "GET /health HTTP/1.1" 200 OK1844gitlab # [ 241.934207] systemd[1]: Started nixbot CI service.1845gitlab # [ 241.935550] systemd[1]: Reached target Multi-User System.1846gitlab # [ 241.937079] systemd[1]: Startup finished in 1.160s (kernel) + 3.267s (initrd) + 3min 57.508s (userspace) = 4min 1.936s.1847gitlab # [ 242.173609] sidekiq-cluster[2815]: {"severity":"INFO","time":"2026-08-13T13:16:47.842Z","message":"Starting cluster with 1 processes"}1848gitlab: (finished: waiting for unit nixbot.service, in 1.03 seconds)1849gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1850gitlab # [ 242.382596] nixbot[2948]: INFO: ::ffff:127.0.0.1:50366 - "GET /health HTTP/1.1" 200 OK1851gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.02 seconds)1852subtest: project discovered and webhook registered1853gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1854gitlab # [ 242.466384] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 641855gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.08 seconds)1856[]1857gitlab # [ 243.428510] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:49 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 14961858gitlab # [ 243.431085] nixbot[2948]: {"ts": "2026-08-13T13:16:49.128Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1859gitlab # [ 243.444967] nixbot[2948]: {"ts": "2026-08-13T13:16:49.142Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1860gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1861gitlab # [ 243.518274] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 641862gitlab # [ 243.520826] nixbot[2948]: {"ts": "2026-08-13T13:16:49.217Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1863gitlab # [ 243.521646] nixbot[2948]: {"ts": "2026-08-13T13:16:49.218Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1864gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.07 seconds)1865[]1866gitlab # [ 243.536321] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 491867gitlab # [ 243.650353] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 1241868gitlab # [ 243.651363] nixbot[2948]: {"ts": "2026-08-13T13:16:49.349Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1869gitlab # [ 243.816588] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:49 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1561870gitlab # [ 243.817213] nixbot[2948]: {"ts": "2026-08-13T13:16:49.514Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1871gitlab # [ 243.905658] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 811872gitlab # [ 243.907375] nixbot[2948]: {"ts": "2026-08-13T13:16:49.605Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1873gitlab # [ 243.975596] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:49 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 651874gitlab # [ 243.976707] nixbot[2948]: {"ts": "2026-08-13T13:16:49.674Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1875gitlab # [ 244.030971] gitaly[914]: time="2026-08-13T13:16:49.728Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9B4FY0SDFJ3WNMT4PTS5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-13T13:17:19.021" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:16:49.722" grpc.time_ms=5.915 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876gitlab # [ 244.047201] gitaly[914]: time="2026-08-13T13:16:49.745Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9B4FY0SDFJ3WNMT4PTS5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:17:19.043" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:16:49.744" grpc.time_ms=0.673 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877gitlab # [ 244.057246] gitaly[914]: time="2026-08-13T13:16:49.755Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9B4FY0SDFJ3WNMT4PTS5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-13T13:16:59.059" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:16:49.749" grpc.time_ms=5.173 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878gitlab # [ 244.085185] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1031879gitlab # [ 244.085968] nixbot[2948]: {"ts": "2026-08-13T13:16:49.783Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1880gitlab # [ 244.169945] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 801881gitlab # [ 244.173603] nixbot[2948]: {"ts": "2026-08-13T13:16:49.868Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1882gitlab # [ 244.177626] nixbot[2948]: {"ts": "2026-08-13T13:16:49.872Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1883gitlab # [ 244.260223] gitaly[914]: time="2026-08-13T13:16:49.958Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BB41GEQD90FKB9H43WH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:49.951" grpc.time_ms=6.122 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1884gitlab # [ 244.276868] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 651885gitlab # [ 244.456245] gitaly[914]: time="2026-08-13T13:16:50.153Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9BD8Q4X6SB7RT828VYPK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.146" pid=914 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1886gitlab # [ 244.470320] gitaly[914]: time="2026-08-13T13:16:50.153Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9BD8Q4X6SB7RT828VYPK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.146" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1887gitlab # [ 244.490532] gitlab-workhorse[822]: time="2026-08-13T13:16:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131888gitlab # [ 244.493857] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1941889gitlab # [ 244.497405] gitaly[914]: time="2026-08-13T13:16:50.154Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9BD8Q4X6SB7RT828VYPK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.146" grpc.time_ms=6.926 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1890gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1891gitlab # [ 244.527354] gitaly[914]: time="2026-08-13T13:16:50.224Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9BKEXHE00H20TX1W596D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.214" pid=914 remote_ip="2001:db8:1::1" request_sha=3ce0dc16546b160be4a0475f72cdeef2fd011f14 response_bytes=224 span.kind=server system=grpc1892gitlab # [ 244.543268] gitaly[914]: time="2026-08-13T13:16:50.225Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1197 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9BKEXHE00H20TX1W596D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.214" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1893gitlab # [ 244.560163] gitaly[914]: time="2026-08-13T13:16:50.225Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1197 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9BKEXHE00H20TX1W596D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.214" grpc.time_ms=10.454 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1894gitlab # [ 244.578323] gitlab-workhorse[822]: time="2026-08-13T13:16:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2241895gitlab # [ 244.581258] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 224 "" "git/2.55.0" 921896gitlab # [ 244.630440] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 691897gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds)1898[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-13T13:16:49.334Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]1899(finished: subtest: project discovered and webhook registered, in 2.25 seconds)1900subtest: push delivers the webhook1901gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1902gitlab # [ 244.655123] gitaly[914]: time="2026-08-13T13:16:50.353Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BQTN7W4FGFHMXH3BRSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.344" grpc.time_ms=7.976 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1903gitlab # [ 244.671824] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 551904gitlab # [ 244.707585] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:50 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 361905gitlab # [ 244.732787] gitaly[914]: time="2026-08-13T13:16:50.430Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9BSKXZFAAHPJ66109XQP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.419" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1906gitlab # [ 244.746683] gitaly[914]: time="2026-08-13T13:16:50.430Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9BSKXZFAAHPJ66109XQP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.419" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1907gitlab # [ 244.763600] gitlab-workhorse[822]: time="2026-08-13T13:16:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671908gitlab # [ 244.766809] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 761909gitlab # [ 244.769952] gitaly[914]: time="2026-08-13T13:16:50.431Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9BSKXZFAAHPJ66109XQP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.419" grpc.time_ms=11.094 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1910gitlab # [ 244.806061] gitaly[914]: time="2026-08-13T13:16:50.502Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BV6VVZM840HZ51EHXS6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.496" grpc.time_ms=5.994 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1911gitlab # [ 244.807211] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:50 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 971912gitlab # Enumerating objects: 5, done.1913gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1914gitlab # Delta compression using up to 4 threads1915gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1916gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 272 bytes | 272.00 KiB/s, done.1917gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1918gitlab # [ 244.896753] gitaly[914]: time="2026-08-13T13:16:50.594Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BZD7W2CYJF407RM1G95 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.587" grpc.time_ms=6.952 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1919gitlab # [ 244.899490] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 551920gitlab # [ 244.987046] gitaly[914]: time="2026-08-13T13:16:50.684Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9C186WZ7ZQGYPBN6GCT5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.667" pid=914 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1921gitlab # [ 244.988209] gitaly[914]: time="2026-08-13T13:16:50.684Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9C186WZ7ZQGYPBN6GCT5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.667" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1922gitlab # [ 244.990220] gitaly[914]: time="2026-08-13T13:16:50.688Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9C186WZ7ZQGYPBN6GCT5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.667" grpc.time_ms=18.832 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1923gitlab # [ 245.029078] gitaly[914]: time="2026-08-13T13:16:50.726Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=3 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-13T13:17:20.017" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-13T13:16:50.718" grpc.time_ms=8.396 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1924gitlab # [ 245.042959] gitaly[914]: time="2026-08-13T13:16:50.740Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZXM9BYVD05WSPZY84XNK94K duration_ms=74ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/allowed"1925gitlab # [ 245.058564] gitlab-workhorse[822]: time="2026-08-13T13:16:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091926gitlab # [ 245.061363] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1571927gitlab # [ 245.079414] gitaly[914]: time="2026-08-13T13:16:50.777Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZXM9BYVD05WSPZY84XNK94K duration_ms=36ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/pre_receive"1928gitlab # [ 245.083879] gitaly[914]: time="2026-08-13T13:16:50.777Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5308 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:16:50.665" grpc.time_ms=112.195 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1929gitlab # [ 245.122096] gitaly[914]: time="2026-08-13T13:16:50.820Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:16:50.819" grpc.time_ms=0.458 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1930gitlab # [ 245.159593] gitaly[914]: time="2026-08-13T13:16:50.857Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4777 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:16:50.857" grpc.time_ms=0.378 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1931gitlab # [ 245.172945] gitaly[914]: time="2026-08-13T13:16:50.869Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:17:20.067" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:16:50.868" grpc.time_ms=0.72 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1932gitlab # [ 245.192499] gitaly[914]: time="2026-08-13T13:16:50.890Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:16:50.889" grpc.time_ms=0.418 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1933gitlab # [ 245.217262] gitaly[914]: time="2026-08-13T13:16:50.915Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-13T13:17:20.106" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:16:50.906" grpc.time_ms=6.612 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1934gitlab # [ 245.235313] gitaly[914]: time="2026-08-13T13:16:50.933Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:17:00.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:16:50.927" grpc.time_ms=5.317 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1935gitlab # [ 245.253037] gitaly[914]: time="2026-08-13T13:16:50.947Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:17:00.021" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:16:50.941" grpc.time_ms=5.722 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1936gitlab # [ 245.279121] gitaly[914]: time="2026-08-13T13:16:50.976Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZXM9BYVD05WSPZY84XNK94K duration_ms=66ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/post_receive"1937gitlab # [ 245.279582] gitaly[914]: time="2026-08-13T13:16:50.976Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4802 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:16:50.909" grpc.time_ms=66.928 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1938gitlab # [ 245.300985] gitaly[914]: time="2026-08-13T13:16:50.998Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K diskcache=b0f8e0f2-5e9a-4eb6-8ebd-c2e56e6fec33 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.613" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1939gitlab # [ 245.301837] gitaly[914]: time="2026-08-13T13:16:50.998Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=133 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13301 command.oublock=32 command.real_time_ms=381 command.spawn_token_fork_ms=0 command.system_time_ms=66 command.user_time_ms=67 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=604 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:16:50.613" grpc.time_ms=385.284 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1940gitlab # [ 245.304145] gitlab-workhorse[822]: time="2026-08-13T13:16:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521941gitlab # [ 245.305953] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:51 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4781942gitlab # To http://gitlab/root/test-flake.git1943gitlab # 8f8c0a6..87abee0 master -> master1944gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.70 seconds)1945gitlab: must succeed: git -C /tmp/test-flake rev-parse master1946gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1947gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'1948gitlab # [ 245.380116] gitaly[914]: time="2026-08-13T13:16:51.076Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-13T13:17:01.005" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:51.075" grpc.time_ms=0.281 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 245.407737] gitaly[914]: time="2026-08-13T13:16:51.105Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-13T13:17:01.027" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:16:51.098" grpc.time_ms=7.309 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1950gitlab # [ 245.423479] nixbot[2948]: INFO: ::ffff:127.0.0.1:40954 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK1951gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.07 seconds)1952[]1953gitlab # [ 245.455612] gitaly[914]: time="2026-08-13T13:16:51.153Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4147 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:16:51.153" grpc.time_ms=0.394 pid=914 span.kind=server system=grpc1954gitlab # [ 245.492367] gitaly[914]: time="2026-08-13T13:16:51.190Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:16:51.189" grpc.time_ms=0.487 pid=914 span.kind=server system=grpc1955gitlab # [ 245.510313] gitaly[914]: time="2026-08-13T13:16:51.208Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 diskcache=ceab27fb-c09d-4886-9782-8fbb9f9fd5e2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T13:17:01.054" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:51.125" pid=914 ref=refs/keep-around/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 remote_ip="2001:db8:1::1" revision=8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 span.kind=server system=grpc username=root1956gitlab # [ 245.511310] gitaly[914]: time="2026-08-13T13:16:51.208Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=59 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5631 command.oublock=8 command.real_time_ms=77 command.spawn_token_fork_ms=2 command.system_time_ms=36 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T13:17:01.054" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:16:51.125" grpc.time_ms=82.777 pid=914 ref=refs/keep-around/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 remote_ip="2001:db8:1::1" revision=8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 span.kind=server system=grpc username=root1957gitlab # [ 245.515252] gitaly[914]: time="2026-08-13T13:16:51.213Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:17:21.011" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:16:51.212" grpc.time_ms=0.71 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 245.677420] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5711959gitlab # [ 245.678919] nixbot[2948]: {"ts": "2026-08-13T13:16:51.375Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 \"HTTP/1.1 201 Created\""}1960gitlab # [ 245.685501] nixbot[2948]: {"ts": "2026-08-13T13:16:51.383Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-8f8c0a6022e2-0"}1961gitlab # [ 245.733258] systemd[1]: Started Nix Daemon.1962gitlab # [ 245.768538] nix-daemon[3176]: accepted connection from pid 3170, user nixbot1963gitlab # [ 245.843507] nix-daemon[3176]: accepted connection from pid 3183, user nixbot1964gitlab # [ 245.854813] nixbot[2948]: {"ts": "2026-08-13T13:16:51.552Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-8f8c0a6022e2-0", "argv0": "bwrap"}1965gitlab # [ 245.947121] nix-daemon[3176]: accepted connection from pid 3193, user nixbot1966gitlab # [ 245.998871] nix-daemon[3176]: accepted connection from pid 3203, user nixbot1967gitlab # [ 246.010297] nix-daemon[3176]: accepted connection from pid 3193, user nixbot1968gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'1969gitlab # [ 246.442237] nixbot[2948]: INFO: ::ffff:127.0.0.1:40958 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK1970gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)1971[]1972gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'1973gitlab # [ 247.459144] nixbot[2948]: INFO: ::ffff:127.0.0.1:40972 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK1974gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)1975[]1976gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'1977gitlab # [ 248.476711] nixbot[2948]: INFO: ::ffff:127.0.0.1:40980 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK1978gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)1979[]1980gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'1981gitlab # [ 249.495870] nixbot[2948]: INFO: ::ffff:127.0.0.1:40984 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK1982gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)1983[]1984gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'1985gitlab # [ 250.516528] nixbot[2948]: INFO: ::ffff:127.0.0.1:40988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK1986gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)1987[]1988gitlab # [ 250.648911] nix-daemon[3176]: accepted connection from pid 3231, user nixbot1989gitlab # [ 250.686776] gitaly[914]: time="2026-08-13T13:16:56.384Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9HMDE9C3JT5RDNYK3H22 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:17:26.183" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:16:56.383" grpc.time_ms=0.605 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1990gitlab # [ 250.734764] gitaly[914]: time="2026-08-13T13:16:56.432Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9HMDE9C3JT5RDNYK3H22 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:17:06.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:16:56.427" grpc.time_ms=5.119 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1991gitlab # [ 250.798681] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 HTTP/1.1" 201 670 "" "python-httpx/0.28.1" 1621992gitlab # [ 250.802176] nixbot[2948]: {"ts": "2026-08-13T13:16:56.497Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 \"HTTP/1.1 201 Created\""}1993gitlab # [ 250.852076] gitaly[914]: time="2026-08-13T13:16:56.549Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9HSMJBWCS7B89CAM80JY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:17:26.348" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:16:56.548" grpc.time_ms=0.826 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1994gitlab # [ 250.885480] gitaly[914]: time="2026-08-13T13:16:56.583Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9HSMJBWCS7B89CAM80JY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:17:06.157" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:16:56.578" grpc.time_ms=5.287 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1995gitlab # [ 250.954479] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:16:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1511996gitlab # [ 250.958044] nixbot[2948]: {"ts": "2026-08-13T13:16:56.653Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 \"HTTP/1.1 201 Created\""}1997gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'1998gitlab # [ 251.536331] nixbot[2948]: INFO: ::ffff:127.0.0.1:41004 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK1999gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2000[]2001gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2002gitlab # [ 252.553794] nixbot[2948]: INFO: ::ffff:127.0.0.1:41016 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2003gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2004[]2005gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2006gitlab # [ 253.571794] nixbot[2948]: INFO: ::ffff:127.0.0.1:47652 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2007gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2008[]2009gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2010gitlab # [ 254.590301] nixbot[2948]: INFO: ::ffff:127.0.0.1:47664 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2011gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2012[]2013gitlab # [ 255.112946] nix-daemon[3176]: accepted connection from pid 3269, user nixbot2014gitlab # [ 255.184345] gitaly[914]: time="2026-08-13T13:17:00.881Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9P104XW1V7CEP4Z6PV3S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:17:30.180" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:17:00.881" grpc.time_ms=0.548 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2015gitlab # [ 255.333362] gitaly[914]: time="2026-08-13T13:17:01.031Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9P104XW1V7CEP4Z6PV3S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:17:11.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:17:01.025" grpc.time_ms=5.273 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2016gitlab # [ 255.437350] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:17:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3022017gitlab # [ 255.442151] nixbot[2948]: {"ts": "2026-08-13T13:17:01.139Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 \"HTTP/1.1 201 Created\""}2018gitlab # [ 255.510219] nix-daemon[3176]: accepted connection from pid 3284, user nixbot2019gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2020gitlab # [ 255.590145] gitaly[914]: time="2026-08-13T13:17:01.288Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9PDS4RDXZ0SWA6R099F3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:17:01.282" grpc.time_ms=5.1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2021gitlab # [ 255.606081] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:17:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 622022gitlab # [ 255.613644] nixbot[2948]: INFO: ::ffff:127.0.0.1:47676 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2023gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2024[]2025gitlab # [ 255.669336] gitaly[914]: time="2026-08-13T13:17:01.367Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9PFWAW6QXY0HM3H9H2PD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:17:01.361" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2026gitlab # [ 255.670436] gitaly[914]: time="2026-08-13T13:17:01.368Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9PFWAW6QXY0HM3H9H2PD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:17:01.361" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2027gitlab # [ 255.671351] gitaly[914]: time="2026-08-13T13:17:01.368Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9PFWAW6QXY0HM3H9H2PD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:17:01.361" grpc.time_ms=7.024 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2028gitlab # [ 255.715233] gitlab-workhorse[822]: time="2026-08-13T13:17:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672029gitlab # [ 255.715926] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:17:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1042030gitlab # [ 255.786081] gitaly[914]: time="2026-08-13T13:17:01.484Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9PKAANBQGKQ8GZZA58Z7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:17:01.475" pid=914 remote_ip="2001:db8:1::1" request_sha=5d3bb649d9e87d6729286be33f6e54a60060f8c9 response_bytes=337 span.kind=server system=grpc2031gitlab # [ 255.786924] gitaly[914]: time="2026-08-13T13:17:01.484Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1194 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9PKAANBQGKQ8GZZA58Z7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:17:01.475" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2032gitlab # [ 255.788301] gitaly[914]: time="2026-08-13T13:17:01.485Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1194 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9PKAANBQGKQ8GZZA58Z7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:17:01.475" grpc.time_ms=9.383 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2033gitlab # [ 255.789718] gitlab-workhorse[822]: time="2026-08-13T13:17:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3372034gitlab # [ 255.791107] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:17:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 672035gitlab # [ 255.904865] nix-daemon[3176]: accepted connection from pid 3322, user nixbot2036gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2037gitlab # [ 256.637630] nixbot[2948]: INFO: ::ffff:127.0.0.1:47684 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2038gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2039[]2040gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2041gitlab # [ 257.658117] nixbot[2948]: INFO: ::ffff:127.0.0.1:47686 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2042gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2043[]2044gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2045gitlab # [ 258.678953] nixbot[2948]: INFO: ::ffff:127.0.0.1:47696 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2046gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2047[]2048gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2049gitlab # [ 259.700314] nixbot[2948]: INFO: ::ffff:127.0.0.1:47702 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2050gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2051[]2052gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2053gitlab # [ 260.722821] nixbot[2948]: INFO: ::ffff:127.0.0.1:47716 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2054gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2055[]2056gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2057gitlab # [ 261.750384] nixbot[2948]: INFO: ::ffff:127.0.0.1:47720 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2058gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.03 seconds)2059[]2060gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2061gitlab # [ 262.768845] nixbot[2948]: INFO: ::ffff:127.0.0.1:47736 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2062gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2063[]2064gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2065gitlab # [ 263.787231] nixbot[2948]: INFO: ::ffff:127.0.0.1:41648 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2066gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2067[]2068gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2069gitlab # [ 264.806344] nixbot[2948]: INFO: ::ffff:127.0.0.1:41654 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2070gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2071[]2072gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2073gitlab # [ 265.828102] nixbot[2948]: INFO: ::ffff:127.0.0.1:41666 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2074gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2075[]2076gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2077gitlab # [ 266.848961] nixbot[2948]: INFO: ::ffff:127.0.0.1:41674 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2078gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2079[]2080gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2081gitlab # [ 267.868445] nixbot[2948]: INFO: ::ffff:127.0.0.1:41680 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2082gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2083[]2084gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2085gitlab # [ 268.887266] nixbot[2948]: INFO: ::ffff:127.0.0.1:41688 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2086gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2087[]2088gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2089gitlab # [ 269.906091] nixbot[2948]: INFO: ::ffff:127.0.0.1:41702 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2090gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2091[]2092gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2093gitlab # [ 270.931366] nixbot[2948]: INFO: ::ffff:127.0.0.1:41706 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2094gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.03 seconds)2095[]2096gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2097gitlab # [ 271.953364] nixbot[2948]: INFO: ::ffff:127.0.0.1:41718 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2098gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2099[]2100gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2101gitlab # [ 272.978981] nixbot[2948]: INFO: ::ffff:127.0.0.1:46840 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2102gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2103[]2104gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2105gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2106[]2107gitlab # [ 274.001176] nixbot[2948]: INFO: ::ffff:127.0.0.1:46850 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2108gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2109gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2110[]2111gitlab # [ 275.019333] nixbot[2948]: INFO: ::ffff:127.0.0.1:46858 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2112gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2113gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2114[]2115gitlab # [ 276.035398] nixbot[2948]: INFO: ::ffff:127.0.0.1:46872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2116gitlab # [ 276.521927] sidekiq-cluster[2979]: 2026-08-13T13:17:22.219Z pid=2979 tid=xe3 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2979, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432160768}2117gitlab # [ 276.752976] sidekiq-cluster[2979]: W, [2026-08-13T13:17:22.450840 #2979] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.2118gitlab # [ 276.807211] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:22.504Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}2119gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2120gitlab # [ 277.053300] nixbot[2948]: INFO: ::ffff:127.0.0.1:46878 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2121gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2122[]2123gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2124gitlab # [ 278.074293] nixbot[2948]: INFO: ::ffff:127.0.0.1:46886 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2125gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2126[]2127gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2128gitlab # [ 279.097595] nixbot[2948]: INFO: ::ffff:127.0.0.1:46902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2129gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2130[]2131gitlab # [ 279.158487] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:24.855Z","message":"GitLab reliable fetch activated!"}2132gitlab # [ 279.159063] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:24.856Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2133gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2134gitlab # [ 280.117203] nixbot[2948]: INFO: ::ffff:127.0.0.1:46916 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2135gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2136[]2137gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2138gitlab # [ 281.138672] nixbot[2948]: INFO: ::ffff:127.0.0.1:46926 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2139gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2140[]2141gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2142gitlab # [ 282.158220] nixbot[2948]: INFO: ::ffff:127.0.0.1:46938 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2143gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2144[]2145gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2146gitlab # [ 283.177212] nixbot[2948]: INFO: ::ffff:127.0.0.1:36330 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2147gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2148[]2149gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2150gitlab # [ 284.197527] nixbot[2948]: INFO: ::ffff:127.0.0.1:36340 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2151gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2152[]2153gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2154gitlab # [ 285.216912] nixbot[2948]: INFO: ::ffff:127.0.0.1:36352 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2155gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2156[]2157gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2158gitlab # [ 286.235535] nixbot[2948]: INFO: ::ffff:127.0.0.1:36362 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2159gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2160[]2161gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2162gitlab # [ 287.253924] nixbot[2948]: INFO: ::ffff:127.0.0.1:36376 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2163gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2164[]2165gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2166gitlab # [ 288.275741] nixbot[2948]: INFO: ::ffff:127.0.0.1:36384 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2167gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2168[]2169gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2170gitlab # [ 289.295044] nixbot[2948]: INFO: ::ffff:127.0.0.1:36390 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2171gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2172[]2173gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2174gitlab # [ 290.313986] nixbot[2948]: INFO: ::ffff:127.0.0.1:36402 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2175gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2176[]2177gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2178gitlab # [ 291.333771] nixbot[2948]: INFO: ::ffff:127.0.0.1:36414 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2179gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2180[]2181gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2182gitlab # [ 292.353824] nixbot[2948]: INFO: ::ffff:127.0.0.1:36420 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2183gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2184[]2185gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2186gitlab # [ 293.375481] nixbot[2948]: INFO: ::ffff:127.0.0.1:56970 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2187gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2188[]2189gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2190gitlab # [ 294.398727] nixbot[2948]: INFO: ::ffff:127.0.0.1:56982 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2191gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2192[]2193gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2194gitlab # [ 295.422279] nixbot[2948]: INFO: ::ffff:127.0.0.1:56994 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2195gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2196[]2197gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2198gitlab # [ 296.442319] nixbot[2948]: INFO: ::ffff:127.0.0.1:57002 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2199gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2200[]2201gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2202gitlab # [ 297.461687] nixbot[2948]: INFO: ::ffff:127.0.0.1:57012 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2203gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2204[]2205gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2206gitlab # [ 298.483313] nixbot[2948]: INFO: ::ffff:127.0.0.1:57024 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2207gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2208[]2209gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2210gitlab # [ 299.504906] nixbot[2948]: INFO: ::ffff:127.0.0.1:57036 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2211gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2212[]2213gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2214gitlab # [ 300.524041] nixbot[2948]: INFO: ::ffff:127.0.0.1:57046 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2215gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2216[]2217gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2218gitlab # [ 301.544134] nixbot[2948]: INFO: ::ffff:127.0.0.1:57050 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2219gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2220[]2221gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2222gitlab # [ 302.563440] nixbot[2948]: INFO: ::ffff:127.0.0.1:57062 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2223gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2224[]2225gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2226gitlab # [ 303.584701] nixbot[2948]: INFO: ::ffff:127.0.0.1:38712 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2227gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2228[]2229gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2230gitlab # [ 304.608941] nixbot[2948]: INFO: ::ffff:127.0.0.1:38720 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2231gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.03 seconds)2232[]2233gitlab # [ 305.467672] postgres[3497]: [3497] ERROR: relation "table_without_models" does not exist2234gitlab # [ 305.471239] postgres[3497]: [3497] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2235gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2236gitlab # [ 305.634311] nixbot[2948]: INFO: ::ffff:127.0.0.1:38736 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2237gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2238[]2239gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2240gitlab # [ 306.654104] nixbot[2948]: INFO: ::ffff:127.0.0.1:38742 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2241gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2242[]2243gitlab # [ 307.347946] redis[786]: 10 changes in 300 seconds. Saving...2244gitlab # [ 307.348876] redis[786]: Background saving started by pid 35092245gitlab # [ 307.356211] redis[3509]: BGSAVE done, 458 keys saved, 0 keys skipped, 117837 bytes written.2246gitlab # [ 307.360556] redis[3509]: DB saved on disk2247gitlab # [ 307.361256] redis[3509]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB2248gitlab # [ 307.448875] redis[786]: Background saving terminated with success2249gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2250gitlab # [ 307.676753] nixbot[2948]: INFO: ::ffff:127.0.0.1:38756 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2251gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2252[]2253gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2254gitlab # [ 308.698799] nixbot[2948]: INFO: ::ffff:127.0.0.1:38760 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2255gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2256[]2257gitlab # [ 308.819878] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:54.516Z","message":"Booted Rails 7.2.3.1 application in production environment"}2258gitlab # [ 308.820855] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:54.517Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}2259gitlab # [ 308.821670] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:54.517Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2260gitlab # [ 308.822517] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:54.517Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2261gitlab # [ 308.823041] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:54.518Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2262gitlab # [ 309.212798] postgres[855]: [855] LOG: checkpoint starting: time2263gitlab # [ 309.577997] gitaly[914]: time="2026-08-13T13:17:55.275Z" level=info msg="burden monitor stats" pid=9142264gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2265gitlab # [ 309.721148] nixbot[2948]: INFO: ::ffff:127.0.0.1:38766 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2266gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2267[]2268gitlab # [ 310.535490] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:56.232Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8455f50629320a1008915da4","created_at":"2026-08-13T13:16:44.238Z","trace_propagation_headers":{"sentry-trace":"1eccd4422642461c91f277bf092ded07-b68f0724fc0647ec","baggage":"sentry-trace_id=1eccd4422642461c91f277bf092ded07,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM94V3FJBNSSP5ZZXRCXGH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:44.271Z","job_size_bytes":2,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8455f50629320a1008915da4: start","job_status":"start","queue_duration_s":71.960889,"scheduling_latency_s":71.960948}2269gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2270gitlab # [ 310.716180] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:56.413Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8455f50629320a1008915da4","created_at":"2026-08-13T13:16:44.238Z","trace_propagation_headers":{"sentry-trace":"1eccd4422642461c91f277bf092ded07-b68f0724fc0647ec","baggage":"sentry-trace_id=1eccd4422642461c91f277bf092ded07,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM94V3FJBNSSP5ZZXRCXGH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:44.271Z","job_size_bytes":2,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8455f50629320a1008915da4: done: 0.181019 sec","job_status":"done","queue_duration_s":71.960889,"scheduling_latency_s":71.960948,"redis_calls":25,"redis_duration_s":0.006279,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.00334,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001604,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001335,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.090746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.088582487,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.181019,"completed_at":"2026-08-13T13:17:56.413Z","load_balancing_strategy":"primary","db_duration_s":0.041262,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2271gitlab # [ 310.717760] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:56.415Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"49a4921dd938017d6ceb79a2","created_at":"2026-08-13T13:16:44.282Z","trace_propagation_headers":{"sentry-trace":"1eccd4422642461c91f277bf092ded07-b68f0724fc0647ec","baggage":"sentry-trace_id=1eccd4422642461c91f277bf092ded07,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM94V3FJBNSSP5ZZXRCXGH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:44.289Z","job_size_bytes":2,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-49a4921dd938017d6ceb79a2: start","job_status":"start","queue_duration_s":72.125575,"scheduling_latency_s":72.125604}2272gitlab # [ 310.817050] nixbot[2948]: INFO: ::ffff:127.0.0.1:38778 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2273gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.10 seconds)2274[]2275gitlab # [ 310.831617] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:56.529Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"49a4921dd938017d6ceb79a2","created_at":"2026-08-13T13:16:44.282Z","trace_propagation_headers":{"sentry-trace":"1eccd4422642461c91f277bf092ded07-b68f0724fc0647ec","baggage":"sentry-trace_id=1eccd4422642461c91f277bf092ded07,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM94V3FJBNSSP5ZZXRCXGH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:44.289Z","job_size_bytes":2,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-49a4921dd938017d6ceb79a2: done: 0.113724 sec","job_status":"done","queue_duration_s":72.125575,"scheduling_latency_s":72.125604,"redis_calls":14,"redis_duration_s":0.00774,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001152,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004107,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002481,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.080657458,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.113724,"completed_at":"2026-08-13T13:17:56.529Z","load_balancing_strategy":"primary","db_duration_s":0.018923,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2276gitlab # [ 310.887498] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:56.585Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"eb831e8c78df909c5f91990a","created_at":"2026-08-13T13:16:44.854Z","trace_propagation_headers":{"sentry-trace":"1eccd4422642461c91f277bf092ded07-b68f0724fc0647ec","baggage":"sentry-trace_id=1eccd4422642461c91f277bf092ded07,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM94V3FJBNSSP5ZZXRCXGH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:44.862Z","job_size_bytes":5,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-eb831e8c78df909c5f91990a: start","job_status":"start","queue_duration_s":71.722183,"scheduling_latency_s":71.722216}2277gitlab # [ 311.039435] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:56.736Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"eb831e8c78df909c5f91990a","created_at":"2026-08-13T13:16:44.854Z","trace_propagation_headers":{"sentry-trace":"1eccd4422642461c91f277bf092ded07-b68f0724fc0647ec","baggage":"sentry-trace_id=1eccd4422642461c91f277bf092ded07,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM94V3FJBNSSP5ZZXRCXGH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:44.862Z","job_size_bytes":5,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-eb831e8c78df909c5f91990a: done: 0.152037 sec","job_status":"done","queue_duration_s":71.722183,"scheduling_latency_s":71.722216,"redis_calls":12,"redis_duration_s":0.003186,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000946,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001743,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000497,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.122037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000383009,"duration_s":0.152037,"completed_at":"2026-08-13T13:17:56.736Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019706,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2278gitlab # [ 311.041247] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:56.738Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"98a2ba10660f50c5b9cd6566","created_at":"2026-08-13T13:16:44.883Z","trace_propagation_headers":{"sentry-trace":"1eccd4422642461c91f277bf092ded07-b68f0724fc0647ec","baggage":"sentry-trace_id=1eccd4422642461c91f277bf092ded07,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM94V3FJBNSSP5ZZXRCXGH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:44.887Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-98a2ba10660f50c5b9cd6566: start","job_status":"start","queue_duration_s":71.851178,"scheduling_latency_s":71.851217}2279gitlab # [ 311.311830] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:57.009Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"98a2ba10660f50c5b9cd6566","created_at":"2026-08-13T13:16:44.883Z","trace_propagation_headers":{"sentry-trace":"1eccd4422642461c91f277bf092ded07-b68f0724fc0647ec","baggage":"sentry-trace_id=1eccd4422642461c91f277bf092ded07,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM94V3FJBNSSP5ZZXRCXGH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:44.887Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-98a2ba10660f50c5b9cd6566: done: 0.270654 sec","job_status":"done","queue_duration_s":71.851178,"scheduling_latency_s":71.851217,"redis_calls":11,"redis_duration_s":0.005316,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.003411,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001438,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000467,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.079,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.171,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.171,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.078,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.147489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000442794,"duration_s":0.270654,"completed_at":"2026-08-13T13:17:57.009Z","load_balancing_strategy":"primary","db_duration_s":0.122961,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2280gitlab # [ 311.364381] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:57.062Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"7f5cd48ba5e5a58d737f15df","created_at":"2026-08-13T13:16:44.889Z","trace_propagation_headers":{"sentry-trace":"1eccd4422642461c91f277bf092ded07-b68f0724fc0647ec","baggage":"sentry-trace_id=1eccd4422642461c91f277bf092ded07,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM94V3FJBNSSP5ZZXRCXGH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:44.894Z","job_size_bytes":89,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-7f5cd48ba5e5a58d737f15df: start","job_status":"start","queue_duration_s":72.167931,"scheduling_latency_s":72.167967}2281gitlab # [ 311.426038] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:57.123Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"7f5cd48ba5e5a58d737f15df","created_at":"2026-08-13T13:16:44.889Z","trace_propagation_headers":{"sentry-trace":"1eccd4422642461c91f277bf092ded07-b68f0724fc0647ec","baggage":"sentry-trace_id=1eccd4422642461c91f277bf092ded07,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM94V3FJBNSSP5ZZXRCXGH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:44.894Z","job_size_bytes":89,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-7f5cd48ba5e5a58d737f15df: done: 0.061658 sec","job_status":"done","queue_duration_s":72.167931,"scheduling_latency_s":72.167967,"redis_calls":11,"redis_duration_s":0.005591,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000762,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00437,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000459,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001910019,"duration_s":0.061658,"completed_at":"2026-08-13T13:17:57.123Z","load_balancing_strategy":"primary","db_duration_s":0.005144,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2282gitlab # [ 311.484039] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:57.181Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b46efc161687f07bd34db4bc","created_at":"2026-08-13T13:16:45.964Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-35d85339d3554a8e","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:45.970Z","job_size_bytes":185,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b46efc161687f07bd34db4bc: start","job_status":"start","queue_duration_s":71.210841,"scheduling_latency_s":71.210879}2283gitlab # [ 311.506356] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:57.204Z","message":"changes: \"0000000000000000000000000000000000000000 8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 refs/heads/master\\n\""}2284gitlab # [ 311.544722] gitaly[914]: time="2026-08-13T13:17:57.242Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:18:07.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:17:57.237" grpc.time_ms=4.93 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2285gitlab # [ 311.553732] gitaly[914]: time="2026-08-13T13:17:57.251Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T13:18:07.017" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:17:57.247" grpc.time_ms=4.115 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2286gitlab # [ 311.626424] gitaly[914]: time="2026-08-13T13:17:57.324Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-13T13:18:07.087" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:17:57.317" grpc.time_ms=6.523 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2287gitlab # [ 311.658955] gitaly[914]: time="2026-08-13T13:17:57.356Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3930 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:17:57.356" grpc.time_ms=0.325 pid=914 span.kind=server system=grpc2288gitlab # [ 311.690181] gitaly[914]: time="2026-08-13T13:17:57.388Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3932 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:17:57.387" grpc.time_ms=0.427 pid=914 span.kind=server system=grpc2289gitlab # [ 311.710302] gitaly[914]: time="2026-08-13T13:17:57.408Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 diskcache=8d526e59-dee7-4f39-a6d2-6ad895f0df5c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T13:18:07.104" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:17:57.335" pid=914 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2290gitlab # [ 311.723310] gitaly[914]: time="2026-08-13T13:17:57.421Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=54 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5027 command.oublock=8 command.real_time_ms=65 command.spawn_token_fork_ms=0 command.system_time_ms=33 command.user_time_ms=21 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T13:18:07.104" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:17:57.335" grpc.time_ms=73.216 pid=914 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2291gitlab # [ 311.740801] gitaly[914]: time="2026-08-13T13:17:57.437Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-13T13:18:07.206" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:17:57.436" grpc.time_ms=0.142 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2292gitlab # [ 311.752779] gitaly[914]: time="2026-08-13T13:17:57.450Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=937 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-13T13:18:07.211" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:17:57.441" grpc.time_ms=8.766 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2293gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2294gitlab # [ 311.824791] gitaly[914]: time="2026-08-13T13:17:57.522Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-13T13:18:27.018" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:17:57.518" grpc.time_ms=3.747 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2295gitlab # [ 311.852351] gitaly[914]: time="2026-08-13T13:17:57.550Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-13T13:18:07.009" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:17:57.549" grpc.time_ms=0.207 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2296gitlab # [ 311.860528] nixbot[2948]: INFO: ::ffff:127.0.0.1:38780 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2297gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.04 seconds)2298[]2299gitlab # [ 311.871713] gitaly[914]: time="2026-08-13T13:17:57.569Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-13T13:18:07.026" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-13T13:17:57.566" grpc.time_ms=3.119 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2300gitlab # [ 311.905504] gitaly[914]: time="2026-08-13T13:17:57.603Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=617 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:18:07.057" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:17:57.597" grpc.time_ms=5.269 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2301gitlab # [ 311.932206] gitaly[914]: time="2026-08-13T13:17:57.630Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:18:07.084" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:17:57.624" grpc.time_ms=5.347 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2302gitlab # [ 311.957890] gitaly[914]: time="2026-08-13T13:17:57.655Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-13T13:18:27.142" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:17:57.642" grpc.time_ms=12.668 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2303gitlab # [ 312.371928] gitaly[914]: time="2026-08-13T13:17:58.069Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-13T13:18:08.008" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:17:58.068" grpc.time_ms=1.002 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2304gitlab # [ 312.408135] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:58.105Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b46efc161687f07bd34db4bc","created_at":"2026-08-13T13:16:45.964Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-35d85339d3554a8e","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:45.970Z","job_size_bytes":185,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b46efc161687f07bd34db4bc: done: 0.92399 sec","job_status":"done","queue_duration_s":71.210841,"scheduling_latency_s":71.210879,"gitaly_calls":13,"gitaly_duration_s":0.249797,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.060993,"redis_read_bytes":2103,"redis_write_bytes":21749,"redis_cache_calls":15,"redis_cache_duration_s":0.003895,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006304,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001566,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7837,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003851,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.032504,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.012873,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.216,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.237,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.577423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000881956,"exclusive_lock_hold_duration_s":0.029061794,"duration_s":0.92399,"completed_at":"2026-08-13T13:17:58.105Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.072219,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2305gitlab # [ 312.475523] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:58.107Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 87abee05220de882b3af755e55d7910f1b8d5780 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c301040780261561f79c35b2","created_at":"2026-08-13T13:16:50.950Z","trace_propagation_headers":{"sentry-trace":"0fe4b2c475a44a35b7d45f5e4f17c708-dbe0bb0ddcbd4ec2","baggage":"sentry-trace_id=0fe4b2c475a44a35b7d45f5e4f17c708,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM9BYVD05WSPZY84XNK94K","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:50.953Z","job_size_bytes":185,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c301040780261561f79c35b2: start","job_status":"start","queue_duration_s":67.153918,"scheduling_latency_s":67.153946}2306gitlab # [ 312.476079] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:58.120Z","message":"changes: \"8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 87abee05220de882b3af755e55d7910f1b8d5780 refs/heads/master\\n\""}2307gitlab # [ 312.476794] gitaly[914]: time="2026-08-13T13:17:58.154Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:18:08.078" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:17:58.138" grpc.time_ms=15.601 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2308gitlab # [ 312.478353] gitaly[914]: time="2026-08-13T13:17:58.176Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-13T13:18:08.108" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:17:58.168" grpc.time_ms=7.214 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2309gitlab # [ 312.483676] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:58.181Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"dfcce626d926dd76ace0c1e6","created_at":"2026-08-13T13:17:58.179Z","trace_propagation_headers":{"sentry-trace":"0fe4b2c475a44a35b7d45f5e4f17c708-8f0b46e95e614947","baggage":"sentry-trace_id=0fe4b2c475a44a35b7d45f5e4f17c708,sentry-release=Unknown"},"correlation_id":"01KZXM9BYVD05WSPZY84XNK94K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"d70a56ce780d434db2cc7f91","job_size_bytes":46,"pid":2979,"job_status":"deduplicated","message":"ProjectCacheWorker JID-dfcce626d926dd76ace0c1e6: deduplicated: until executing","deduplication.type":"until executing"}2310gitlab # [ 312.550207] gitaly[914]: time="2026-08-13T13:17:58.200Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-13T13:18:08.134" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:17:58.194" grpc.time_ms=5.097 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2311gitlab # [ 312.551332] gitaly[914]: time="2026-08-13T13:17:58.210Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-13T13:18:28.004" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:17:58.204" grpc.time_ms=5.654 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2312gitlab # [ 312.552333] gitaly[914]: time="2026-08-13T13:17:58.220Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-13T13:18:08.157" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-13T13:17:58.217" grpc.time_ms=3.164 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2313gitlab # [ 312.555788] gitaly[914]: time="2026-08-13T13:17:58.233Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:18:08.168" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:17:58.228" grpc.time_ms=5.36 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2314gitlab # [ 312.614668] gitaly[914]: time="2026-08-13T13:17:58.312Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-13T13:18:08.081" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:17:58.311" grpc.time_ms=0.805 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2315gitlab # [ 312.632114] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:58.329Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 87abee05220de882b3af755e55d7910f1b8d5780 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c301040780261561f79c35b2","created_at":"2026-08-13T13:16:50.950Z","trace_propagation_headers":{"sentry-trace":"0fe4b2c475a44a35b7d45f5e4f17c708-dbe0bb0ddcbd4ec2","baggage":"sentry-trace_id=0fe4b2c475a44a35b7d45f5e4f17c708,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM9BYVD05WSPZY84XNK94K","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-13T13:16:50.953Z","job_size_bytes":185,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c301040780261561f79c35b2: done: 0.222455 sec","job_status":"done","queue_duration_s":67.153918,"scheduling_latency_s":67.153946,"gitaly_calls":7,"gitaly_duration_s":0.069869,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.019275,"redis_read_bytes":500,"redis_write_bytes":11938,"redis_cache_calls":9,"redis_cache_duration_s":0.002277,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001098,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5715,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002658,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.007425,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.005817,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.014,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.12889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000798705,"exclusive_lock_hold_duration_s":0.034258823,"duration_s":0.222455,"completed_at":"2026-08-13T13:17:58.329Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022986,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2316gitlab # [ 312.687497] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:58.331Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"7d5718da3148190d93d09775","created_at":"2026-08-13T13:16:51.220Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-dbf8fe3afbcf4bdd","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:51.237Z","job_size_bytes":65,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-7d5718da3148190d93d09775: start","job_status":"start","queue_duration_s":67.094017,"scheduling_latency_s":67.094051}2317gitlab # [ 312.729388] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:58.427Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"7d5718da3148190d93d09775","created_at":"2026-08-13T13:16:51.220Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-dbf8fe3afbcf4bdd","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:51.237Z","job_size_bytes":65,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-7d5718da3148190d93d09775: done: 0.095336 sec","job_status":"done","queue_duration_s":67.094017,"scheduling_latency_s":67.094051,"redis_calls":16,"redis_duration_s":0.004887,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002415,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000714,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000418489,"duration_s":0.095336,"completed_at":"2026-08-13T13:17:58.426Z","load_balancing_strategy":"primary","db_duration_s":0.025765,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2318gitlab # [ 312.784266] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:58.481Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"819cd4ad81cb14d1475ccb0e","created_at":"2026-08-13T13:16:51.239Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-dbf8fe3afbcf4bdd","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:51.243Z","job_size_bytes":65,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-819cd4ad81cb14d1475ccb0e: start","job_status":"start","queue_duration_s":67.238089,"scheduling_latency_s":67.238128}2319gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2320gitlab # [ 312.888589] nixbot[2948]: INFO: ::ffff:127.0.0.1:38782 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2321gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.02 seconds)2322[]2323gitlab # [ 312.997737] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:58.695Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"819cd4ad81cb14d1475ccb0e","created_at":"2026-08-13T13:16:51.239Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-dbf8fe3afbcf4bdd","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:51.243Z","job_size_bytes":65,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-819cd4ad81cb14d1475ccb0e: done: 0.213614 sec","job_status":"done","queue_duration_s":67.238089,"scheduling_latency_s":67.238128,"redis_calls":21,"redis_duration_s":0.0072569999999999996,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003165,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002251,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001841,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.150127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000416533,"duration_s":0.213614,"completed_at":"2026-08-13T13:17:58.695Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023557,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2324gitlab # [ 313.055093] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:58.752Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"579d2b8e125d01754186e2df","created_at":"2026-08-13T13:16:51.347Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-dbf8fe3afbcf4bdd","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:51.353Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-579d2b8e125d01754186e2df: start","job_status":"start","queue_duration_s":67.398805,"scheduling_latency_s":67.398849}2325gitlab # [ 313.227883] gitaly[914]: time="2026-08-13T13:17:58.925Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:17:58.925" grpc.time_ms=0.309 pid=914 span.kind=server system=grpc2326gitlab # [ 313.258546] gitaly[914]: time="2026-08-13T13:17:58.956Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3889 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:17:58.956" grpc.time_ms=0.375 pid=914 span.kind=server system=grpc2327gitlab # [ 313.288696] gitaly[914]: time="2026-08-13T13:17:58.986Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:17:58.985" grpc.time_ms=0.609 pid=914 span.kind=server system=grpc2328gitlab # [ 313.314324] gitaly[914]: time="2026-08-13T13:17:59.012Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 diskcache=6a37db65-b3c5-4f74-861c-47ae7d1e39e4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T13:18:28.405" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:17:58.906" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2329gitlab # [ 313.314887] gitaly[914]: time="2026-08-13T13:17:59.012Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=91 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7308 command.oublock=0 command.real_time_ms=99 command.spawn_token_fork_ms=0 command.system_time_ms=47 command.user_time_ms=44 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T13:18:28.405" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:17:58.906" grpc.time_ms=106.184 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2330gitlab # [ 313.427268] gitaly[914]: time="2026-08-13T13:17:59.125Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T13:18:29.023" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:17:59.123" grpc.time_ms=1.042 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2331gitlab # [ 313.472328] gitaly[914]: time="2026-08-13T13:17:59.170Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:18:29.068" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:17:59.169" grpc.time_ms=0.655 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2332gitlab # [ 313.499794] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:59.197Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"579d2b8e125d01754186e2df","created_at":"2026-08-13T13:16:51.347Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-dbf8fe3afbcf4bdd","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:51.353Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2979,"job_status":"rescheduled","message":"PipelineProcessWorker JID-579d2b8e125d01754186e2df: rescheduled"}2333gitlab # [ 313.529612] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:59.227Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"579d2b8e125d01754186e2df","created_at":"2026-08-13T13:16:51.347Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-dbf8fe3afbcf4bdd","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T13:16:51.353Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-579d2b8e125d01754186e2df: done: 0.474762 sec","job_status":"done","queue_duration_s":67.398805,"scheduling_latency_s":67.398849,"gitaly_calls":3,"gitaly_duration_s":0.14482,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.048944999999999995,"redis_read_bytes":462,"redis_write_bytes":29295,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001197,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002267,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.009966,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004477,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15583,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.02591,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000662,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":165,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000619,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00265,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.017,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.022,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.217196,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.374884797,"duration_s":0.474762,"completed_at":"2026-08-13T13:17:59.227Z","load_balancing_strategy":"primary","db_duration_s":0.056921,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2334gitlab # [ 313.542734] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:59.228Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d70a56ce780d434db2cc7f91","created_at":"2026-08-13T13:17:57.278Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-6de361cf6d9549b7","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:57.293Z","job_size_bytes":46,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d70a56ce780d434db2cc7f91: start","job_status":"start","queue_duration_s":1.935129,"scheduling_latency_s":1.935156}2335gitlab # [ 313.579530] gitaly[914]: time="2026-08-13T13:17:59.277Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-13T19:17:59.274" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:17:59.274" grpc.time_ms=2.088 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2336gitlab # [ 313.645666] gitaly[914]: time="2026-08-13T13:17:59.343Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-13T13:18:29.237" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:17:59.338" grpc.time_ms=5.349 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2337gitlab # [ 313.671422] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:59.368Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d70a56ce780d434db2cc7f91","created_at":"2026-08-13T13:17:57.278Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-6de361cf6d9549b7","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:57.293Z","job_size_bytes":46,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d70a56ce780d434db2cc7f91: done: 0.139718 sec","job_status":"done","queue_duration_s":1.935129,"scheduling_latency_s":1.935156,"gitaly_calls":2,"gitaly_duration_s":0.065836,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.008513,"redis_read_bytes":69,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001422,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000479,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001456,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004455,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000701,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000338311,"duration_s":0.139718,"completed_at":"2026-08-13T13:17:59.368Z","load_balancing_strategy":"primary","db_duration_s":0.010673,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2338gitlab # [ 313.731709] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:59.429Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"4761c8e46654eabf228c4d90","created_at":"2026-08-13T13:17:57.306Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-6de361cf6d9549b7","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:57.311Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-4761c8e46654eabf228c4d90: start","job_status":"start","queue_duration_s":2.117483,"scheduling_latency_s":2.117515}2339gitlab # [ 313.770507] gitaly[914]: time="2026-08-13T13:17:59.468Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 diskcache=c3fb8359-957e-407e-aba8-61d559bb53e3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-13T19:17:59.454" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:17:59.454" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2340gitlab # [ 313.771155] gitaly[914]: time="2026-08-13T13:17:59.468Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1285 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-13T19:17:59.454" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:17:59.454" grpc.time_ms=13.643 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2341gitlab # [ 313.807555] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:59.505Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"4761c8e46654eabf228c4d90","created_at":"2026-08-13T13:17:57.306Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-6de361cf6d9549b7","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:57.311Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-4761c8e46654eabf228c4d90: done: 0.075773 sec","job_status":"done","queue_duration_s":2.117483,"scheduling_latency_s":2.117515,"gitaly_calls":1,"gitaly_duration_s":0.015961,"redis_calls":15,"redis_duration_s":0.003761,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00059,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001375,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00066,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.019,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.048278482,"duration_s":0.075773,"completed_at":"2026-08-13T13:17:59.505Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013038,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2342gitlab # [ 313.810394] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:59.506Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"cb8fbfd92c1674ba08e7a5a2","created_at":"2026-08-13T13:17:57.432Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-6de361cf6d9549b7","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:57.434Z","job_size_bytes":23,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-cb8fbfd92c1674ba08e7a5a2: start","job_status":"start","queue_duration_s":2.072912,"scheduling_latency_s":2.072942}2343gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2344gitlab # [ 313.841710] gitaly[914]: time="2026-08-13T13:17:59.539Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-13T13:18:29.434" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:17:59.534" grpc.time_ms=4.899 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2345gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.05 seconds)2346[]2347gitlab # [ 313.851676] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:59.549Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"cb8fbfd92c1674ba08e7a5a2","created_at":"2026-08-13T13:17:57.432Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-6de361cf6d9549b7","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:57.434Z","job_size_bytes":23,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-cb8fbfd92c1674ba08e7a5a2: done: 0.042339 sec","job_status":"done","queue_duration_s":2.072912,"scheduling_latency_s":2.072942,"gitaly_calls":1,"gitaly_duration_s":0.007007,"redis_calls":16,"redis_duration_s":0.0038150000000000002,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000274,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001114,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001649,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000778,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042339,"completed_at":"2026-08-13T13:17:59.549Z","load_balancing_strategy":"primary","db_duration_s":0.003717,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2348gitlab # [ 313.907049] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:17:59.550Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c6954430435522b59e848121","created_at":"2026-08-13T13:17:57.918Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-6de361cf6d9549b7","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:679ef416e259df71d73d11cfc04647a7cd999660eb3072f7617a3384c7a7863d","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:57.922Z","job_size_bytes":467,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c6954430435522b59e848121: start","job_status":"start","queue_duration_s":1.628491,"scheduling_latency_s":1.62852}2349gitlab # [ 313.969930] gitaly[914]: time="2026-08-13T13:17:59.579Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:18:29.478" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:17:59.578" grpc.time_ms=0.522 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2350gitlab # [ 313.971315] nixbot[2948]: INFO: ::ffff:127.0.0.1:50830 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2351gitlab # [ 313.972432] gitaly[914]: time="2026-08-13T13:17:59.585Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-13T13:18:09.041" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:17:59.581" grpc.time_ms=3.713 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2352gitlab # [ 314.000690] gitaly[914]: time="2026-08-13T13:17:59.698Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T13:18:29.597" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:17:59.697" grpc.time_ms=0.71 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2353gitlab # [ 314.007055] gitaly[914]: time="2026-08-13T13:17:59.704Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=327 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-13T13:18:29.601" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:17:59.701" grpc.time_ms=3.314 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2354gitlab # [ 314.085299] gitaly[914]: time="2026-08-13T13:17:59.783Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:18:09.237" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:17:59.778" grpc.time_ms=4.717 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2355gitlab # [ 314.732813] gitaly[914]: time="2026-08-13T13:18:00.430Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-13T13:18:30.320" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:00.421" grpc.time_ms=9.243 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2356gitlab # [ 314.741634] gitaly[914]: time="2026-08-13T13:18:00.439Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9726EH11QY5THTME2M62 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-13T13:18:30.333" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:00.433" grpc.time_ms=5.956 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2357gitlab # [ 314.797819] sidekiq-cluster[2979]: {"severity":"WARN","time":"2026-08-13T13:18:00.495Z","class":"CreatePipelineWorker","correlation_id":"01KZXM9726EH11QY5THTME2M62","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"8f8c0a6022e286e5b07b0f666f094dc7839e0ed2","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"8f8c0a6022e286e5b07b0f666f094dc7839e0ed2","ref":"refs/heads/master"},"retry":0}2358gitlab # [ 314.805486] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:00.503Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c6954430435522b59e848121","created_at":"2026-08-13T13:17:57.918Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-6de361cf6d9549b7","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:679ef416e259df71d73d11cfc04647a7cd999660eb3072f7617a3384c7a7863d","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:57.922Z","job_size_bytes":467,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c6954430435522b59e848121: done: 0.952151 sec","job_status":"done","queue_duration_s":1.628491,"scheduling_latency_s":1.62852,"gitaly_calls":7,"gitaly_duration_s":0.070526,"redis_calls":51,"redis_duration_s":0.012362,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.00083,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005758,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002739,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001095,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.804499,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000390553,"duration_s":0.952151,"completed_at":"2026-08-13T13:18:00.503Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048987,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2359gitlab # [ 314.813323] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:00.504Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"55bb0a37-5660-43e2-b55e-44deaac3a41b\"}"],"class":"WebHookWorker","jid":"2f828cce3d2174aa3ac5c534","created_at":"2026-08-13T13:17:58.039Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-6de361cf6d9549b7","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7447a8c6ee8290a0c8fa52e6ce9b0fe7d3eeedf9eabe45f017055d75339709e3","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:58.043Z","job_size_bytes":1751,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-2f828cce3d2174aa3ac5c534: start","job_status":"start","queue_duration_s":2.461025,"scheduling_latency_s":2.461057}2360gitlab # [ 314.927659] nixbot[2948]: INFO: ::ffff:127.0.0.1:50842 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2361gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2362gitlab # [ 314.952144] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:00.649Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"55bb0a37-5660-43e2-b55e-44deaac3a41b\"}"],"class":"WebHookWorker","jid":"2f828cce3d2174aa3ac5c534","created_at":"2026-08-13T13:17:58.039Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-6de361cf6d9549b7","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7447a8c6ee8290a0c8fa52e6ce9b0fe7d3eeedf9eabe45f017055d75339709e3","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:58.043Z","job_size_bytes":1751,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-2f828cce3d2174aa3ac5c534: done: 0.144613 sec","job_status":"done","queue_duration_s":2.461025,"scheduling_latency_s":2.461057,"redis_calls":19,"redis_duration_s":0.004961,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000962,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000595,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002179,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001225,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.042030481999972835,"cpu_s":0.081734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000500902,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.144613,"completed_at":"2026-08-13T13:18:00.649Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004627,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2363gitlab # [ 314.959934] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:00.654Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"2b113fcd55c36dd98d968452","created_at":"2026-08-13T13:17:58.186Z","trace_propagation_headers":{"sentry-trace":"0fe4b2c475a44a35b7d45f5e4f17c708-8f0b46e95e614947","baggage":"sentry-trace_id=0fe4b2c475a44a35b7d45f5e4f17c708,sentry-release=Unknown"},"correlation_id":"01KZXM9BYVD05WSPZY84XNK94K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"4761c8e46654eabf228c4d90","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:58.189Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-2b113fcd55c36dd98d968452: start","job_status":"start","queue_duration_s":2.464661,"scheduling_latency_s":2.464696}2364gitlab # [ 315.029426] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:00.712Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"2b113fcd55c36dd98d968452","created_at":"2026-08-13T13:17:58.186Z","trace_propagation_headers":{"sentry-trace":"0fe4b2c475a44a35b7d45f5e4f17c708-8f0b46e95e614947","baggage":"sentry-trace_id=0fe4b2c475a44a35b7d45f5e4f17c708,sentry-release=Unknown"},"correlation_id":"01KZXM9BYVD05WSPZY84XNK94K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"4761c8e46654eabf228c4d90","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:58.189Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-2b113fcd55c36dd98d968452: done: 0.058559 sec","job_status":"done","queue_duration_s":2.464661,"scheduling_latency_s":2.464696,"gitaly_calls":1,"gitaly_duration_s":0.011933,"redis_calls":12,"redis_duration_s":0.004241,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001431,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001263,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001547,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.030294632,"duration_s":0.058559,"completed_at":"2026-08-13T13:18:00.712Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008417,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2365gitlab # [ 315.083768] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:00.716Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"11ba147b5cfb2d9eecffcf43","created_at":"2026-08-13T13:17:58.273Z","trace_propagation_headers":{"sentry-trace":"0fe4b2c475a44a35b7d45f5e4f17c708-8f0b46e95e614947","baggage":"sentry-trace_id=0fe4b2c475a44a35b7d45f5e4f17c708,sentry-release=Unknown"},"correlation_id":"01KZXM9BYVD05WSPZY84XNK94K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9bc13032844f3f98dedc92ee51e00a9f315adee04eae55983e3c629c9e3bed38","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:58.275Z","job_size_bytes":467,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-11ba147b5cfb2d9eecffcf43: start","job_status":"start","queue_duration_s":2.440471,"scheduling_latency_s":2.440523}2366gitlab # [ 315.084789] gitaly[914]: time="2026-08-13T13:18:00.691Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K diskcache=c0f94172-0615-4186-a3a9-cbbd8e63b95c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-13T19:18:00.681" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:00.682" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2367gitlab # [ 315.085892] gitaly[914]: time="2026-08-13T13:18:00.691Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-13T19:18:00.681" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:00.682" grpc.time_ms=8.364 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2368gitlab # [ 315.086895] gitaly[914]: time="2026-08-13T13:18:00.747Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:18:30.646" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:00.746" grpc.time_ms=0.795 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2369gitlab # [ 315.099521] gitaly[914]: time="2026-08-13T13:18:00.760Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-13T13:18:10.210" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:00.751" grpc.time_ms=8.981 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2370gitlab # [ 315.115887] gitaly[914]: time="2026-08-13T13:18:00.793Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T13:18:30.692" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:00.792" grpc.time_ms=0.866 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2371gitlab # [ 315.169735] gitaly[914]: time="2026-08-13T13:18:00.813Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=323 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-13T13:18:30.701" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:00.802" grpc.time_ms=10.229 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2372gitlab # [ 315.170875] gitaly[914]: time="2026-08-13T13:18:00.848Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:18:10.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:00.841" grpc.time_ms=7.048 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2373gitlab # [ 315.224162] gitaly[914]: time="2026-08-13T13:18:00.921Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMBGE4CA3BR228QHRK5JXA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:00.916" grpc.time_ms=5.749 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2374gitlab # [ 315.225795] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:00 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 2782375gitlab # [ 315.236854] nixbot[2948]: INFO: ::ffff:127.0.0.1:50850 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2376gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.31 seconds)2377[]2378gitlab # [ 315.321303] gitaly[914]: time="2026-08-13T13:18:01.019Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBGPX6PWNND31634W0NAV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:01.013" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2379gitlab # [ 315.333728] gitaly[914]: time="2026-08-13T13:18:01.019Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBGPX6PWNND31634W0NAV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:01.013" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2380gitlab # [ 315.349806] gitlab-workhorse[822]: time="2026-08-13T13:18:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672381gitlab # [ 315.352336] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 952382gitlab # [ 315.355311] gitaly[914]: time="2026-08-13T13:18:01.019Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBGPX6PWNND31634W0NAV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:01.013" grpc.time_ms=6.249 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2383gitlab # [ 315.355838] nixbot[2948]: {"ts": "2026-08-13T13:18:01.048Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2384gitlab # [ 315.441950] gitaly[914]: time="2026-08-13T13:18:01.139Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBGVN0BYWK8A9SB7S1554 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:18:31.038" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:01.139" grpc.time_ms=0.506 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2385gitlab # [ 315.544572] gitaly[914]: time="2026-08-13T13:18:01.242Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZXMBGVN0BYWK8A9SB7S1554 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:18:11.166" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:01.236" grpc.time_ms=5.578 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2386gitlab # [ 315.621495] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2412387gitlab # [ 315.623712] nixbot[2948]: {"ts": "2026-08-13T13:18:01.321Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 \"HTTP/1.1 201 Created\""}2388gitlab # [ 315.665961] gitaly[914]: time="2026-08-13T13:18:01.363Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-13T13:18:31.255" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:01.355" grpc.time_ms=8.049 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2389gitlab # [ 315.681333] gitaly[914]: time="2026-08-13T13:18:01.379Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBH3DA6HTS9672RG3NAP3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:18:31.277" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:01.378" grpc.time_ms=0.696 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2390gitlab # [ 315.709446] gitaly[914]: time="2026-08-13T13:18:01.407Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9BYVD05WSPZY84XNK94K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-13T13:18:31.300" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:01.400" grpc.time_ms=6.635 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2391gitlab # [ 315.725709] gitaly[914]: time="2026-08-13T13:18:01.423Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMBH3DA6HTS9672RG3NAP3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:18:11.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:01.418" grpc.time_ms=4.965 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2392gitlab # [ 315.756547] sidekiq-cluster[2979]: {"severity":"WARN","time":"2026-08-13T13:18:01.454Z","class":"CreatePipelineWorker","correlation_id":"01KZXM9BYVD05WSPZY84XNK94K","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"8f8c0a6022e286e5b07b0f666f094dc7839e0ed2","after":"87abee05220de882b3af755e55d7910f1b8d5780","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"87abee05220de882b3af755e55d7910f1b8d5780","ref":"refs/heads/master"},"retry":0}2393gitlab # [ 315.762271] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.459Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"11ba147b5cfb2d9eecffcf43","created_at":"2026-08-13T13:17:58.273Z","trace_propagation_headers":{"sentry-trace":"0fe4b2c475a44a35b7d45f5e4f17c708-8f0b46e95e614947","baggage":"sentry-trace_id=0fe4b2c475a44a35b7d45f5e4f17c708,sentry-release=Unknown"},"correlation_id":"01KZXM9BYVD05WSPZY84XNK94K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9bc13032844f3f98dedc92ee51e00a9f315adee04eae55983e3c629c9e3bed38","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:58.275Z","job_size_bytes":467,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-11ba147b5cfb2d9eecffcf43: done: 0.743858 sec","job_status":"done","queue_duration_s":2.440471,"scheduling_latency_s":2.440523,"gitaly_calls":7,"gitaly_duration_s":0.099324,"redis_calls":33,"redis_duration_s":0.0095,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000645,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00115,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.006646,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.056,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.562305,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.743858,"completed_at":"2026-08-13T13:18:01.459Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.058358,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2394gitlab # [ 315.822334] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.462Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"50cd62a9-e0d1-4628-adf3-50b76561d1ed\"}"],"class":"WebHookWorker","jid":"aff90c2197a65e904e9bec10","created_at":"2026-08-13T13:17:58.292Z","trace_propagation_headers":{"sentry-trace":"0fe4b2c475a44a35b7d45f5e4f17c708-8f0b46e95e614947","baggage":"sentry-trace_id=0fe4b2c475a44a35b7d45f5e4f17c708,sentry-release=Unknown"},"correlation_id":"01KZXM9BYVD05WSPZY84XNK94K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e95aaf2782e436993676d84a1e8e161f770600b6f1d545c111c651d21140dae1","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:58.295Z","job_size_bytes":1749,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-aff90c2197a65e904e9bec10: start","job_status":"start","queue_duration_s":3.167086,"scheduling_latency_s":3.16711}2395gitlab # [ 315.823788] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.498Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"50cd62a9-e0d1-4628-adf3-50b76561d1ed\"}"],"class":"WebHookWorker","jid":"aff90c2197a65e904e9bec10","created_at":"2026-08-13T13:17:58.292Z","trace_propagation_headers":{"sentry-trace":"0fe4b2c475a44a35b7d45f5e4f17c708-8f0b46e95e614947","baggage":"sentry-trace_id=0fe4b2c475a44a35b7d45f5e4f17c708,sentry-release=Unknown"},"correlation_id":"01KZXM9BYVD05WSPZY84XNK94K","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e95aaf2782e436993676d84a1e8e161f770600b6f1d545c111c651d21140dae1","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:58.295Z","job_size_bytes":1749,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-aff90c2197a65e904e9bec10: done: 0.036444 sec","job_status":"done","queue_duration_s":3.167086,"scheduling_latency_s":3.16711,"redis_calls":14,"redis_duration_s":0.002893,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000688,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001394,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000811,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.007460444999992433,"cpu_s":0.021889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.036444,"completed_at":"2026-08-13T13:18:01.498Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001742,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2396gitlab # [ 315.905277] nixbot[2948]: INFO: ::ffff:127.0.0.1:50866 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2397gitlab # [ 315.907676] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 532398gitlab # [ 315.909044] gitaly[914]: time="2026-08-13T13:18:01.559Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZXMBH92YRCBM9KQM5JX8WN1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:01.552" grpc.time_ms=6.855 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2399gitlab # [ 315.911209] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.500Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"cd1c99a9e9d704693db53a34","created_at":"2026-08-13T13:17:58.887Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:58.893Z","job_size_bytes":23,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-cd1c99a9e9d704693db53a34: start","job_status":"start","queue_duration_s":2.606849,"scheduling_latency_s":2.606873}2400gitlab # [ 315.912179] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.579Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"cd1c99a9e9d704693db53a34","created_at":"2026-08-13T13:17:58.887Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:58.893Z","job_size_bytes":23,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-cd1c99a9e9d704693db53a34: done: 0.079598 sec","job_status":"done","queue_duration_s":2.606849,"scheduling_latency_s":2.606873,"redis_calls":10,"redis_duration_s":0.002624,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0004,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001773,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000451,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000343619,"duration_s":0.079598,"completed_at":"2026-08-13T13:18:01.579Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01523,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2401gitlab # [ 316.010269] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2822402gitlab # [ 316.012170] gitlab-workhorse[822]: time="2026-08-13T13:18:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672403gitlab # [ 316.013157] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 752404gitlab # [ 316.013975] gitaly[914]: time="2026-08-13T13:18:01.636Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBHASFP17G7919F8S7SW3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:01.618" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2405gitlab # [ 316.015041] nixbot[2948]: {"ts": "2026-08-13T13:18:01.609Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 \"HTTP/1.1 201 Created\""}2406gitlab # [ 316.015793] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.581Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2ca91150bca0abe8c9023e93","created_at":"2026-08-13T13:17:59.018Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.024Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2ca91150bca0abe8c9023e93: start","job_status":"start","queue_duration_s":2.556897,"scheduling_latency_s":2.556919}2407gitlab # [ 316.016796] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.609Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2ca91150bca0abe8c9023e93","created_at":"2026-08-13T13:17:59.018Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.024Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2ca91150bca0abe8c9023e93: done: 0.028114 sec","job_status":"done","queue_duration_s":2.556897,"scheduling_latency_s":2.556919,"redis_calls":10,"redis_duration_s":0.003101,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001071,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001564,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000374629,"duration_s":0.028114,"completed_at":"2026-08-13T13:18:01.609Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003421,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2408gitlab # [ 316.075065] gitaly[914]: time="2026-08-13T13:18:01.636Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=7 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBHASFP17G7919F8S7SW3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:01.618" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2409gitlab # [ 316.086707] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.610Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e559809d09471f117dc8538a","created_at":"2026-08-13T13:17:59.036Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.042Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e559809d09471f117dc8538a: start","job_status":"start","queue_duration_s":2.568426,"scheduling_latency_s":2.568448}2410gitlab # [ 316.159435] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.655Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e559809d09471f117dc8538a","created_at":"2026-08-13T13:17:59.036Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.042Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e559809d09471f117dc8538a: done: 0.04457 sec","job_status":"done","queue_duration_s":2.568426,"scheduling_latency_s":2.568448,"redis_calls":10,"redis_duration_s":0.010225,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001376,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003064,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005785,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000398375,"duration_s":0.04457,"completed_at":"2026-08-13T13:18:01.655Z","load_balancing_strategy":"primary","db_duration_s":0.004969,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2411gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2412gitlab # [ 316.163102] gitaly[914]: time="2026-08-13T13:18:01.636Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=7 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBHASFP17G7919F8S7SW3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:01.618" grpc.time_ms=17.981 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2413gitlab # [ 316.231241] nixbot[2948]: {"ts": "2026-08-13T13:18:01.777Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 \"HTTP/1.1 201 Created\""}2414gitlab # [ 316.232414] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8f8c0a6022e286e5b07b0f666f094dc7839e0ed2 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1442415gitlab # [ 316.233306] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.660Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9fafb1c6d58afd5504d747ea","created_at":"2026-08-13T13:17:59.057Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.063Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9fafb1c6d58afd5504d747ea: start","job_status":"start","queue_duration_s":2.596662,"scheduling_latency_s":2.596709}2416gitlab # [ 316.234202] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.697Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9fafb1c6d58afd5504d747ea","created_at":"2026-08-13T13:17:59.057Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.063Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9fafb1c6d58afd5504d747ea: done: 0.037909 sec","job_status":"done","queue_duration_s":2.596662,"scheduling_latency_s":2.596709,"redis_calls":13,"redis_duration_s":0.003169,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000518,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001363,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000799,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000489,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000469054,"duration_s":0.037909,"completed_at":"2026-08-13T13:18:01.697Z","load_balancing_strategy":"primary","db_duration_s":0.004713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2417gitlab # [ 316.313386] gitaly[914]: time="2026-08-13T13:18:01.688Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBHCZ94VN300Z3EN6ST6E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:18:31.587" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:01.687" grpc.time_ms=0.928 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2418gitlab # [ 316.314811] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.703Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7965f94ed9575d5db8d764a7","created_at":"2026-08-13T13:17:59.063Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.068Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7965f94ed9575d5db8d764a7: start","job_status":"start","queue_duration_s":2.634793,"scheduling_latency_s":2.634845}2419gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 0.18 seconds)2420[]2421gitlab # [ 316.324888] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.752Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7965f94ed9575d5db8d764a7","created_at":"2026-08-13T13:17:59.063Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.068Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7965f94ed9575d5db8d764a7: done: 0.048998 sec","job_status":"done","queue_duration_s":2.634793,"scheduling_latency_s":2.634845,"redis_calls":10,"redis_duration_s":0.008027,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000975,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005298,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001754,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000383569,"duration_s":0.048998,"completed_at":"2026-08-13T13:18:01.752Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005501,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2422gitlab # [ 316.397637] gitaly[914]: time="2026-08-13T13:18:01.731Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMBHCZ94VN300Z3EN6ST6E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:18:11.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:01.725" grpc.time_ms=5.656 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2423gitlab # [ 316.457991] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.753Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ea576139006ad58b64129dd3","created_at":"2026-08-13T13:17:59.069Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.075Z","job_size_bytes":19,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ea576139006ad58b64129dd3: start","job_status":"start","queue_duration_s":2.678446,"scheduling_latency_s":2.678468}2424gitlab # [ 316.459056] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.788Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ea576139006ad58b64129dd3","created_at":"2026-08-13T13:17:59.069Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.075Z","job_size_bytes":19,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ea576139006ad58b64129dd3: done: 0.034059 sec","job_status":"done","queue_duration_s":2.678446,"scheduling_latency_s":2.678468,"redis_calls":11,"redis_duration_s":0.004651,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000393,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003755,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000607898,"duration_s":0.034059,"completed_at":"2026-08-13T13:18:01.787Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003693,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2425gitlab # [ 316.487337] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:02 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1012426gitlab # [ 316.488756] gitlab-workhorse[822]: time="2026-08-13T13:18:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672427gitlab # [ 316.491129] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:02 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 572428gitlab # [ 316.493974] nixbot[2948]: INFO: ::ffff:127.0.0.1:50874 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2429gitlab # [ 316.495856] gitaly[914]: time="2026-08-13T13:18:02.090Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=14 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMBHR6F5K6G1TGKR452YAS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:02.064" grpc.time_ms=24.913 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2430gitlab # [ 316.550939] gitaly[914]: time="2026-08-13T13:18:02.152Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBHVHD33YHWGQAN2XPJJE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:02.144" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2431gitlab # [ 316.551894] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.790Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9a5e75f3abadf7a57f56519a","created_at":"2026-08-13T13:17:59.078Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.084Z","job_size_bytes":66,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9a5e75f3abadf7a57f56519a: start","job_status":"start","queue_duration_s":2.706083,"scheduling_latency_s":2.706112}2432gitlab # [ 316.552689] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.940Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9a5e75f3abadf7a57f56519a","created_at":"2026-08-13T13:17:59.078Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.084Z","job_size_bytes":66,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9a5e75f3abadf7a57f56519a: done: 0.150361 sec","job_status":"done","queue_duration_s":2.706083,"scheduling_latency_s":2.706112,"redis_calls":10,"redis_duration_s":0.002689,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000547,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001518,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000624,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.113789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041374,"duration_s":0.150361,"completed_at":"2026-08-13T13:18:01.940Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2433gitlab # [ 316.628986] nix-daemon[3176]: accepted connection from pid 3728, user nixbot2434gitlab # [ 316.630116] gitaly[914]: time="2026-08-13T13:18:02.152Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBHVHD33YHWGQAN2XPJJE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:02.144" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2435gitlab # [ 316.630898] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.942Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b4b44ddb021b5a408b694163","created_at":"2026-08-13T13:17:59.085Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.093Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b4b44ddb021b5a408b694163: start","job_status":"start","queue_duration_s":2.849255,"scheduling_latency_s":2.849279}2436gitlab # [ 316.685994] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.988Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b4b44ddb021b5a408b694163","created_at":"2026-08-13T13:17:59.085Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.093Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b4b44ddb021b5a408b694163: done: 0.045635 sec","job_status":"done","queue_duration_s":2.849255,"scheduling_latency_s":2.849279,"redis_calls":10,"redis_duration_s":0.0027689999999999998,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000728,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001503,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000538,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003696,"duration_s":0.045635,"completed_at":"2026-08-13T13:18:01.988Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009332,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2437gitlab # [ 316.698485] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:02 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 622438gitlab # [ 316.749838] gitlab-workhorse[822]: time="2026-08-13T13:18:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2212439gitlab # [ 316.750835] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:02 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 722440gitlab # [ 316.752176] gitaly[914]: time="2026-08-13T13:18:02.157Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBHVHD33YHWGQAN2XPJJE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:02.144" grpc.time_ms=8.94 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2441gitlab # [ 316.753127] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:01.989Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"91d58487277780ebac9cc766","created_at":"2026-08-13T13:17:59.099Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.102Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-91d58487277780ebac9cc766: start","job_status":"start","queue_duration_s":2.887718,"scheduling_latency_s":2.887741}2442gitlab # [ 316.754137] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.058Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"91d58487277780ebac9cc766","created_at":"2026-08-13T13:17:59.099Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.102Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-91d58487277780ebac9cc766: done: 0.068855 sec","job_status":"done","queue_duration_s":2.887718,"scheduling_latency_s":2.887741,"redis_calls":10,"redis_duration_s":0.006021,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002023,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00308,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000391391,"duration_s":0.068855,"completed_at":"2026-08-13T13:18:02.058Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025301,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2443gitlab # [ 316.814414] gitaly[914]: time="2026-08-13T13:18:02.266Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=11 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZXMBHYW0K8EB4APW83RN1Z3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:02.247" grpc.time_ms=19.392 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2444gitlab # [ 316.815385] gitaly[914]: time="2026-08-13T13:18:02.340Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBJ0Y5Z67K1DQ5Z4BJKWD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:02.328" pid=914 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc2445gitlab # [ 316.869536] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.061Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"bb3bfb00f98a4ab38d64a452","created_at":"2026-08-13T13:17:59.102Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.105Z","job_size_bytes":6,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-bb3bfb00f98a4ab38d64a452: start","job_status":"start","queue_duration_s":2.955974,"scheduling_latency_s":2.95601}2446gitlab # [ 316.870758] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.106Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"bb3bfb00f98a4ab38d64a452","created_at":"2026-08-13T13:17:59.102Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.105Z","job_size_bytes":6,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-bb3bfb00f98a4ab38d64a452: done: 0.045465 sec","job_status":"done","queue_duration_s":2.955974,"scheduling_latency_s":2.95601,"redis_calls":10,"redis_duration_s":0.011456,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002818,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007499,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001139,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000737524,"duration_s":0.045465,"completed_at":"2026-08-13T13:18:02.106Z","load_balancing_strategy":"primary","db_duration_s":0.003662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2447gitlab # [ 316.928280] gitaly[914]: time="2026-08-13T13:18:02.341Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1164 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBJ0Y5Z67K1DQ5Z4BJKWD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:02.328" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2448gitlab # [ 316.929341] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.108Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"9ce5ad217604774a3a052c98","created_at":"2026-08-13T13:17:59.105Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.108Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-9ce5ad217604774a3a052c98: start","job_status":"start","queue_duration_s":2.99998,"scheduling_latency_s":3.000009}2449gitlab # [ 316.930934] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.156Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"9ce5ad217604774a3a052c98","created_at":"2026-08-13T13:17:59.105Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.108Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-9ce5ad217604774a3a052c98: done: 0.048159 sec","job_status":"done","queue_duration_s":2.99998,"scheduling_latency_s":3.000009,"redis_calls":10,"redis_duration_s":0.002787,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000567,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001699,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000521,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000408153,"duration_s":0.048159,"completed_at":"2026-08-13T13:18:02.156Z","load_balancing_strategy":"primary","db_duration_s":0.009049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2450gitlab # [ 317.002989] gitaly[914]: time="2026-08-13T13:18:02.341Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1164 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBJ0Y5Z67K1DQ5Z4BJKWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:02.328" grpc.time_ms=12.942 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2451gitlab # [ 317.003822] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.160Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"c5f119a9eaf6fc66bc698991","created_at":"2026-08-13T13:17:59.113Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.116Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-c5f119a9eaf6fc66bc698991: start","job_status":"start","queue_duration_s":3.043751,"scheduling_latency_s":3.043778}2452gitlab # [ 317.020800] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.234Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"c5f119a9eaf6fc66bc698991","created_at":"2026-08-13T13:17:59.113Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.116Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-c5f119a9eaf6fc66bc698991: done: 0.074042 sec","job_status":"done","queue_duration_s":3.043751,"scheduling_latency_s":3.043778,"redis_calls":14,"redis_duration_s":0.00631,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00061,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001999,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045732,"duration_s":0.074042,"completed_at":"2026-08-13T13:18:02.234Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018669,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2453gitlab # [ 317.082541] gitaly[914]: time="2026-08-13T13:18:02.376Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:18:02.375" grpc.time_ms=0.351 pid=914 span.kind=server system=grpc2454gitlab # [ 317.087399] gitaly[914]: time="2026-08-13T13:18:02.399Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3889 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:18:02.399" grpc.time_ms=0.324 pid=914 span.kind=server system=grpc2455gitlab # [ 317.100347] nixbot[2948]: {"ts": "2026-08-13T13:18:02.741Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/87abee05220de882b3af755e55d7910f1b8d5780 \"HTTP/1.1 201 Created\""}2456gitlab # [ 317.102692] nixbot[2948]: {"ts": "2026-08-13T13:18:02.746Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-87abee05220d-4"}2457gitlab # [ 317.105924] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.236Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"ccf0a3a16492ebc85d8a6e74","created_at":"2026-08-13T13:17:59.197Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.219Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ccf0a3a16492ebc85d8a6e74: start","job_status":"start","queue_duration_s":3.016485,"scheduling_latency_s":3.016521}2458gitlab # [ 317.160738] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.525Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"ccf0a3a16492ebc85d8a6e74","created_at":"2026-08-13T13:17:59.197Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.219Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2979,"job_status":"rescheduled","message":"PipelineProcessWorker JID-ccf0a3a16492ebc85d8a6e74: rescheduled"}2459gitlab # [ 317.164095] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:02 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3732460gitlab # [ 317.165152] nix-daemon[3176]: accepted connection from pid 3814, user nixbot2461gitlab # [ 317.165833] nix-daemon[3176]: accepted connection from pid 3822, user nixbot2462gitlab # [ 317.166955] gitaly[914]: time="2026-08-13T13:18:02.419Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:18:02.419" grpc.time_ms=0.347 pid=914 span.kind=server system=grpc2463gitlab # [ 317.167954] gitaly[914]: time="2026-08-13T13:18:02.425Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBJ3ZKNK69GTSZC0SFQ8C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:18:32.024" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:02.424" grpc.time_ms=0.586 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2464gitlab # [ 317.225296] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.531Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"ccf0a3a16492ebc85d8a6e74","created_at":"2026-08-13T13:17:59.197Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-481b09085b3b499d","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.219Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ccf0a3a16492ebc85d8a6e74: done: 0.295432 sec","job_status":"done","queue_duration_s":3.016485,"scheduling_latency_s":3.016521,"gitaly_calls":3,"gitaly_duration_s":0.081105,"redis_calls":67,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.023036,"redis_read_bytes":150,"redis_write_bytes":18097,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.003987,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001031,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003925,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.005924,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.00049,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001594,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002098,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.032,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.032,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.137268,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.248424031,"duration_s":0.295432,"completed_at":"2026-08-13T13:18:02.531Z","load_balancing_strategy":"primary","db_duration_s":0.059771,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2465gitlab # [ 317.237150] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.533Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"45cc7df1c46c1b79ca4f987e","created_at":"2026-08-13T13:17:59.351Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-6d50e0f9bf504fa3","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.356Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-45cc7df1c46c1b79ca4f987e: start","job_status":"start","queue_duration_s":3.176566,"scheduling_latency_s":3.17659}2466gitlab # [ 317.290037] nixbot[2948]: {"ts": "2026-08-13T13:18:02.859Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-87abee05220d-4", "argv0": "bwrap"}2467gitlab # [ 317.291182] gitaly[914]: time="2026-08-13T13:18:02.425Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 diskcache=00e69277-3655-4a2e-9049-4e64953c8317 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T13:18:32.253" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:02.353" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2468gitlab # [ 317.291914] gitaly[914]: time="2026-08-13T13:18:02.426Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=69 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7652 command.oublock=0 command.real_time_ms=68 command.spawn_token_fork_ms=1 command.system_time_ms=38 command.user_time_ms=31 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T13:18:32.253" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:02.353" grpc.time_ms=72.535 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2469gitlab # [ 317.293066] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.585Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"45cc7df1c46c1b79ca4f987e","created_at":"2026-08-13T13:17:59.351Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-6d50e0f9bf504fa3","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-13T13:17:59.356Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-45cc7df1c46c1b79ca4f987e: done: 0.05291 sec","job_status":"done","queue_duration_s":3.176566,"scheduling_latency_s":3.17659,"redis_calls":19,"redis_duration_s":0.004243,"redis_read_bytes":22,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000895,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000513,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002137,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000698,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008366985,"duration_s":0.05291,"completed_at":"2026-08-13T13:18:02.585Z","load_balancing_strategy":"primary","db_duration_s":0.008166,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2470gitlab # [ 317.356716] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.587Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","2f828cce3d2174aa3ac5c534"],"class":"WebHooks::LogExecutionWorker","jid":"f05ca03c375cb81ca73ed7e2","created_at":"2026-08-13T13:18:00.628Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-cee59362a2c648a3","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:773c56eb52ff70bd7114511a48ae012a4a3f60513c77820b25481ded7c8de7e7","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:00.636Z","job_size_bytes":2593,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-f05ca03c375cb81ca73ed7e2: start","job_status":"start","queue_duration_s":1.950911,"scheduling_latency_s":1.950942}2471gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780'2472gitlab # [ 317.361274] gitaly[914]: time="2026-08-13T13:18:02.439Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZXMBJ3ZKNK69GTSZC0SFQ8C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-13T13:18:32.033" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:02.434" grpc.time_ms=5.145 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2473gitlab # [ 317.378384] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.639Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","2f828cce3d2174aa3ac5c534"],"class":"WebHooks::LogExecutionWorker","jid":"f05ca03c375cb81ca73ed7e2","created_at":"2026-08-13T13:18:00.628Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-cee59362a2c648a3","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:773c56eb52ff70bd7114511a48ae012a4a3f60513c77820b25481ded7c8de7e7","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:00.636Z","job_size_bytes":2593,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-f05ca03c375cb81ca73ed7e2: done: 0.051687 sec","job_status":"done","queue_duration_s":1.950911,"scheduling_latency_s":1.950942,"redis_calls":10,"redis_duration_s":0.003418,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000705,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00168,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000376305,"duration_s":0.051687,"completed_at":"2026-08-13T13:18:02.639Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2474gitlab # [ 317.443287] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.641Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","aff90c2197a65e904e9bec10"],"class":"WebHooks::LogExecutionWorker","jid":"909005f7592bfe64c3c9d07e","created_at":"2026-08-13T13:18:01.490Z","trace_propagation_headers":{"sentry-trace":"0fe4b2c475a44a35b7d45f5e4f17c708-be150c97262340e2","baggage":"sentry-trace_id=0fe4b2c475a44a35b7d45f5e4f17c708,sentry-release=Unknown"},"correlation_id":"01KZXM9BYVD05WSPZY84XNK94K","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5405c6fabd4a21c54ad626eb85707998185112d30916523f6cf0a9a750868826","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.493Z","job_size_bytes":2592,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-909005f7592bfe64c3c9d07e: start","job_status":"start","queue_duration_s":1.1481,"scheduling_latency_s":1.148126}2475gitlab # [ 317.499106] gitaly[914]: time="2026-08-13T13:18:02.457Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=5 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMBJ3ZKNK69GTSZC0SFQ8C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:18:12.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:02.448" grpc.time_ms=8.422 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2476gitlab # [ 317.500091] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.666Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","aff90c2197a65e904e9bec10"],"class":"WebHooks::LogExecutionWorker","jid":"909005f7592bfe64c3c9d07e","created_at":"2026-08-13T13:18:01.490Z","trace_propagation_headers":{"sentry-trace":"0fe4b2c475a44a35b7d45f5e4f17c708-be150c97262340e2","baggage":"sentry-trace_id=0fe4b2c475a44a35b7d45f5e4f17c708,sentry-release=Unknown"},"correlation_id":"01KZXM9BYVD05WSPZY84XNK94K","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5405c6fabd4a21c54ad626eb85707998185112d30916523f6cf0a9a750868826","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:01.493Z","job_size_bytes":2592,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-909005f7592bfe64c3c9d07e: done: 0.024764 sec","job_status":"done","queue_duration_s":1.1481,"scheduling_latency_s":1.148126,"redis_calls":7,"redis_duration_s":0.001719,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001165,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000554,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024764,"completed_at":"2026-08-13T13:18:02.666Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2477gitlab # [ 317.517162] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.668Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"25a42cfa59cd6585e344731b","created_at":"2026-08-13T13:18:02.341Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.346Z","job_size_bytes":23,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-25a42cfa59cd6585e344731b: start","job_status":"start","queue_duration_s":0.321659,"scheduling_latency_s":0.321682}2478gitlab # [ 317.575050] gitaly[914]: time="2026-08-13T13:18:02.484Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T13:18:32.382" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:02.483" grpc.time_ms=0.739 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2479gitlab # [ 317.575898] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.720Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"25a42cfa59cd6585e344731b","created_at":"2026-08-13T13:18:02.341Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.346Z","job_size_bytes":23,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-25a42cfa59cd6585e344731b: done: 0.052518 sec","job_status":"done","queue_duration_s":0.321659,"scheduling_latency_s":0.321682,"redis_calls":7,"redis_duration_s":0.001805,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001258,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000547,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052518,"completed_at":"2026-08-13T13:18:02.720Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011409,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2480gitlab # [ 317.631320] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.722Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"052d8da8473d96d373d15f90","created_at":"2026-08-13T13:18:02.431Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.434Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-052d8da8473d96d373d15f90: start","job_status":"start","queue_duration_s":0.288286,"scheduling_latency_s":0.288322}2481gitlab # [ 317.632678] gitaly[914]: time="2026-08-13T13:18:02.518Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXM9C7J2SZCK2B20AXW90Y6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:18:32.416" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:02.517" grpc.time_ms=0.69 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2482gitlab # [ 317.636249] gitaly[914]: time="2026-08-13T13:18:02.565Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBJ3ZKNK69GTSZC0SFQ8C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-13T13:18:12.124" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:18:02.565" grpc.time_ms=0.213 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2483gitlab # [ 317.688117] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.754Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"052d8da8473d96d373d15f90","created_at":"2026-08-13T13:18:02.431Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.434Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-052d8da8473d96d373d15f90: done: 0.031601 sec","job_status":"done","queue_duration_s":0.288286,"scheduling_latency_s":0.288322,"redis_calls":7,"redis_duration_s":0.00176,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001244,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000516,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031601,"completed_at":"2026-08-13T13:18:02.754Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2484gitlab # [ 317.699465] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.756Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"80aca69b82f13b757956ea6f","created_at":"2026-08-13T13:18:02.440Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.443Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-80aca69b82f13b757956ea6f: start","job_status":"start","queue_duration_s":0.312788,"scheduling_latency_s":0.312815}2485gitlab # [ 317.766107] gitaly[914]: time="2026-08-13T13:18:02.579Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=619 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBJ3ZKNK69GTSZC0SFQ8C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-13T13:18:12.130" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:02.571" grpc.time_ms=7.122 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2486gitlab # [ 317.766947] gitaly[914]: time="2026-08-13T13:18:02.605Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXMBJ3ZKNK69GTSZC0SFQ8C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4147 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:18:02.605" grpc.time_ms=0.422 pid=914 span.kind=server system=grpc2487gitlab # [ 317.767915] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.796Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"80aca69b82f13b757956ea6f","created_at":"2026-08-13T13:18:02.440Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.443Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-80aca69b82f13b757956ea6f: done: 0.040594 sec","job_status":"done","queue_duration_s":0.312788,"scheduling_latency_s":0.312815,"redis_calls":7,"redis_duration_s":0.004554000000000001,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003963,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000591,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040594,"completed_at":"2026-08-13T13:18:02.796Z","load_balancing_strategy":"primary","db_duration_s":0.01037,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2488gitlab # [ 317.799355] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.798Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"bd8d4189e63fd067bc799cb6","created_at":"2026-08-13T13:18:02.451Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.453Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-bd8d4189e63fd067bc799cb6: start","job_status":"start","queue_duration_s":0.345396,"scheduling_latency_s":0.345425}2489gitlab # [ 317.856223] gitaly[914]: time="2026-08-13T13:18:02.627Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXMBJ3ZKNK69GTSZC0SFQ8C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:18:02.627" grpc.time_ms=0.382 pid=914 span.kind=server system=grpc2490gitlab # [ 317.857183] gitaly[914]: time="2026-08-13T13:18:02.634Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBJ3ZKNK69GTSZC0SFQ8C diskcache=daf891b2-9524-4485-a38f-e9c07bfe8e26 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T13:18:12.141" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:18:02.581" pid=914 ref=refs/keep-around/87abee05220de882b3af755e55d7910f1b8d5780 remote_ip="2001:db8:1::1" revision=87abee05220de882b3af755e55d7910f1b8d5780 span.kind=server system=grpc username=root2491gitlab # [ 317.857839] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.826Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"bd8d4189e63fd067bc799cb6","created_at":"2026-08-13T13:18:02.451Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.453Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-bd8d4189e63fd067bc799cb6: done: 0.027821 sec","job_status":"done","queue_duration_s":0.345396,"scheduling_latency_s":0.345425,"redis_calls":10,"redis_duration_s":0.002142,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001135,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000597,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00041,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027821,"completed_at":"2026-08-13T13:18:02.826Z","load_balancing_strategy":"primary","db_duration_s":0.004052,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2492gitlab # [ 317.926827] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.827Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c25948aac55991cf634a47a9","created_at":"2026-08-13T13:18:02.453Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.455Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c25948aac55991cf634a47a9: start","job_status":"start","queue_duration_s":0.372291,"scheduling_latency_s":0.372319}2493gitlab # [ 317.927862] gitaly[914]: time="2026-08-13T13:18:02.635Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=48 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5238 command.oublock=8 command.real_time_ms=48 command.spawn_token_fork_ms=2 command.system_time_ms=28 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBJ3ZKNK69GTSZC0SFQ8C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-13T13:18:12.141" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-13T13:18:02.581" grpc.time_ms=53.519 pid=914 ref=refs/keep-around/87abee05220de882b3af755e55d7910f1b8d5780 remote_ip="2001:db8:1::1" revision=87abee05220de882b3af755e55d7910f1b8d5780 span.kind=server system=grpc username=root2494gitlab # [ 317.983220] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.856Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c25948aac55991cf634a47a9","created_at":"2026-08-13T13:18:02.453Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.455Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c25948aac55991cf634a47a9: done: 0.028234 sec","job_status":"done","queue_duration_s":0.372291,"scheduling_latency_s":0.372319,"redis_calls":7,"redis_duration_s":0.0018059999999999999,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001362,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028234,"completed_at":"2026-08-13T13:18:02.856Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005223,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2495gitlab # [ 317.984734] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.858Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c00a83025282783a41584d2d","created_at":"2026-08-13T13:18:02.456Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.458Z","job_size_bytes":19,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c00a83025282783a41584d2d: start","job_status":"start","queue_duration_s":0.399945,"scheduling_latency_s":0.399969}2496gitlab # [ 318.004302] gitaly[914]: time="2026-08-13T13:18:02.641Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBJ3ZKNK69GTSZC0SFQ8C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:18:32.239" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:02.640" grpc.time_ms=0.775 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2497gitlab # [ 318.018974] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.883Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c00a83025282783a41584d2d","created_at":"2026-08-13T13:18:02.456Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.458Z","job_size_bytes":19,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c00a83025282783a41584d2d: done: 0.02484 sec","job_status":"done","queue_duration_s":0.399945,"scheduling_latency_s":0.399969,"redis_calls":8,"redis_duration_s":0.001957,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001561,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000396,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02484,"completed_at":"2026-08-13T13:18:02.882Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2498gitlab # [ 318.076071] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.885Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"0d9de7c3c2e0e5e997f7ce98","created_at":"2026-08-13T13:18:02.459Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.461Z","job_size_bytes":66,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-0d9de7c3c2e0e5e997f7ce98: start","job_status":"start","queue_duration_s":0.424172,"scheduling_latency_s":0.4242}2499gitlab # [ 318.090126] gitaly[914]: time="2026-08-13T13:18:03.275Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMBJ3ZKNK69GTSZC0SFQ8C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T13:18:33.173" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:03.274" grpc.time_ms=0.97 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2500gitlab # [ 318.105985] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.913Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"0d9de7c3c2e0e5e997f7ce98","created_at":"2026-08-13T13:18:02.459Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.461Z","job_size_bytes":66,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-0d9de7c3c2e0e5e997f7ce98: done: 0.027897 sec","job_status":"done","queue_duration_s":0.424172,"scheduling_latency_s":0.4242,"redis_calls":7,"redis_duration_s":0.0017389999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001321,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027897,"completed_at":"2026-08-13T13:18:02.913Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003685,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2501gitlab # [ 318.183814] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.915Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"b677afc4ada90308783493be","created_at":"2026-08-13T13:18:02.462Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.464Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-b677afc4ada90308783493be: start","job_status":"start","queue_duration_s":0.451137,"scheduling_latency_s":0.451165}2502gitlab # [ 318.184926] gitaly[914]: time="2026-08-13T13:18:03.311Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBJ3ZKNK69GTSZC0SFQ8C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:18:33.209" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:03.310" grpc.time_ms=0.629 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2503gitlab # [ 318.241190] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.945Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"b677afc4ada90308783493be","created_at":"2026-08-13T13:18:02.462Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.464Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-b677afc4ada90308783493be: done: 0.029774 sec","job_status":"done","queue_duration_s":0.451137,"scheduling_latency_s":0.451165,"redis_calls":7,"redis_duration_s":0.0019130000000000002,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001391,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000522,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029774,"completed_at":"2026-08-13T13:18:02.945Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2504gitlab # [ 318.295440] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.947Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"319962f986c5c1e60f96b490","created_at":"2026-08-13T13:18:02.464Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.467Z","job_size_bytes":6,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-319962f986c5c1e60f96b490: start","job_status":"start","queue_duration_s":0.479407,"scheduling_latency_s":0.479437}2505gitlab # [ 318.296689] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.964Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"319962f986c5c1e60f96b490","created_at":"2026-08-13T13:18:02.464Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.467Z","job_size_bytes":6,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-319962f986c5c1e60f96b490: done: 0.016887 sec","job_status":"done","queue_duration_s":0.479407,"scheduling_latency_s":0.479437,"redis_calls":7,"redis_duration_s":0.002066,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001125,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016887,"completed_at":"2026-08-13T13:18:02.964Z","load_balancing_strategy":"primary","db_duration_s":0.000587,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2506gitlab # [ 318.362980] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.967Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"62de8a6ad2731b18114d892e","created_at":"2026-08-13T13:18:02.469Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.472Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-62de8a6ad2731b18114d892e: start","job_status":"start","queue_duration_s":0.494821,"scheduling_latency_s":0.494854}2507gitlab # [ 318.363893] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.996Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"62de8a6ad2731b18114d892e","created_at":"2026-08-13T13:18:02.469Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.472Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-62de8a6ad2731b18114d892e: done: 0.02868 sec","job_status":"done","queue_duration_s":0.494821,"scheduling_latency_s":0.494854,"redis_calls":7,"redis_duration_s":0.002331,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001799,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000532,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02868,"completed_at":"2026-08-13T13:18:02.996Z","load_balancing_strategy":"primary","db_duration_s":0.003733,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2508gitlab # [ 318.429927] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:02.998Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"5b3c844ff3f85ee4b75494a4","created_at":"2026-08-13T13:18:02.526Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.527Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5b3c844ff3f85ee4b75494a4: start","job_status":"start","queue_duration_s":0.470604,"scheduling_latency_s":0.470626}2509gitlab # [ 318.430989] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:03.026Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"5b3c844ff3f85ee4b75494a4","created_at":"2026-08-13T13:18:02.526Z","trace_propagation_headers":{"sentry-trace":"4590eb9b1afb4c6695d22b3305a71ed1-372f07ca5dfd4b29","baggage":"sentry-trace_id=4590eb9b1afb4c6695d22b3305a71ed1,sentry-release=Unknown"},"correlation_id":"01KZXM9C7J2SZCK2B20AXW90Y6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.527Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5b3c844ff3f85ee4b75494a4: done: 0.028023 sec","job_status":"done","queue_duration_s":0.470604,"scheduling_latency_s":0.470626,"redis_calls":8,"redis_duration_s":0.003817,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001993,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028023,"completed_at":"2026-08-13T13:18:03.025Z","load_balancing_strategy":"primary","db_duration_s":0.00359,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2510gitlab # [ 318.483851] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:03.028Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"545fc648fe08bd0e1c4d61cd","created_at":"2026-08-13T13:18:02.570Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-6b09b58b51164a7a","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.575Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-545fc648fe08bd0e1c4d61cd: start","job_status":"start","queue_duration_s":0.452225,"scheduling_latency_s":0.452255}2511gitlab # [ 318.484914] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:03.106Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"545fc648fe08bd0e1c4d61cd","created_at":"2026-08-13T13:18:02.570Z","trace_propagation_headers":{"sentry-trace":"320f084b5ed949098486f5b2789494e8-6b09b58b51164a7a","baggage":"sentry-trace_id=320f084b5ed949098486f5b2789494e8,sentry-release=Unknown"},"correlation_id":"01KZXM9726EH11QY5THTME2M62","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.575Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-545fc648fe08bd0e1c4d61cd: done: 0.078668 sec","job_status":"done","queue_duration_s":0.452225,"scheduling_latency_s":0.452255,"redis_calls":11,"redis_duration_s":0.0035110000000000002,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001344,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001659,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000508,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000364851,"duration_s":0.078668,"completed_at":"2026-08-13T13:18:03.106Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013887,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2512gitlab # [ 318.536937] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:03.108Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"88354836efc782bea220231f","created_at":"2026-08-13T13:18:02.644Z","trace_propagation_headers":{"sentry-trace":"21ea5cc1a50d473ebf838696a26b6054-543f661f2b574cf4","baggage":"sentry-trace_id=21ea5cc1a50d473ebf838696a26b6054,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMBJ3ZKNK69GTSZC0SFQ8C","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.648Z","job_size_bytes":65,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-88354836efc782bea220231f: start","job_status":"start","queue_duration_s":0.459843,"scheduling_latency_s":0.459869}2513gitlab # [ 318.547395] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:03.143Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"88354836efc782bea220231f","created_at":"2026-08-13T13:18:02.644Z","trace_propagation_headers":{"sentry-trace":"21ea5cc1a50d473ebf838696a26b6054-543f661f2b574cf4","baggage":"sentry-trace_id=21ea5cc1a50d473ebf838696a26b6054,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMBJ3ZKNK69GTSZC0SFQ8C","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.648Z","job_size_bytes":65,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-88354836efc782bea220231f: done: 0.034893 sec","job_status":"done","queue_duration_s":0.459843,"scheduling_latency_s":0.459869,"redis_calls":7,"redis_duration_s":0.001725,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001262,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000463,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034893,"completed_at":"2026-08-13T13:18:03.143Z","load_balancing_strategy":"primary","db_duration_s":0.005861,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2514gitlab # [ 318.600417] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:03.145Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"860be175d0a3c6dcdaed2554","created_at":"2026-08-13T13:18:02.649Z","trace_propagation_headers":{"sentry-trace":"21ea5cc1a50d473ebf838696a26b6054-543f661f2b574cf4","baggage":"sentry-trace_id=21ea5cc1a50d473ebf838696a26b6054,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMBJ3ZKNK69GTSZC0SFQ8C","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.651Z","job_size_bytes":65,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-860be175d0a3c6dcdaed2554: start","job_status":"start","queue_duration_s":0.493623,"scheduling_latency_s":0.493648}2515gitlab # [ 318.654880] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:03.196Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"860be175d0a3c6dcdaed2554","created_at":"2026-08-13T13:18:02.649Z","trace_propagation_headers":{"sentry-trace":"21ea5cc1a50d473ebf838696a26b6054-543f661f2b574cf4","baggage":"sentry-trace_id=21ea5cc1a50d473ebf838696a26b6054,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMBJ3ZKNK69GTSZC0SFQ8C","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.651Z","job_size_bytes":65,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-860be175d0a3c6dcdaed2554: done: 0.051339 sec","job_status":"done","queue_duration_s":0.493623,"scheduling_latency_s":0.493648,"redis_calls":10,"redis_duration_s":0.0024679999999999997,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001143,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001325,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051339,"completed_at":"2026-08-13T13:18:03.196Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012976,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2516gitlab # [ 318.722862] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:03.197Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a7ba6e8c1cf92f1483e87a28","created_at":"2026-08-13T13:18:02.721Z","trace_propagation_headers":{"sentry-trace":"21ea5cc1a50d473ebf838696a26b6054-543f661f2b574cf4","baggage":"sentry-trace_id=21ea5cc1a50d473ebf838696a26b6054,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMBJ3ZKNK69GTSZC0SFQ8C","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.726Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a7ba6e8c1cf92f1483e87a28: start","job_status":"start","queue_duration_s":0.471359,"scheduling_latency_s":0.471381}2517gitlab # [ 318.723876] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:03.323Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a7ba6e8c1cf92f1483e87a28","created_at":"2026-08-13T13:18:02.721Z","trace_propagation_headers":{"sentry-trace":"21ea5cc1a50d473ebf838696a26b6054-543f661f2b574cf4","baggage":"sentry-trace_id=21ea5cc1a50d473ebf838696a26b6054,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMBJ3ZKNK69GTSZC0SFQ8C","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:02.726Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a7ba6e8c1cf92f1483e87a28: done: 0.125423 sec","job_status":"done","queue_duration_s":0.471359,"scheduling_latency_s":0.471381,"gitaly_calls":2,"gitaly_duration_s":0.006462,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007235999999999999,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001181,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000864,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000494,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00172,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000358,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000386,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094869,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.092072595,"duration_s":0.125423,"completed_at":"2026-08-13T13:18:03.323Z","load_balancing_strategy":"primary","db_duration_s":0.023789,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2518gitlab # [ 318.794992] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:03.325Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"43d1eedd4c3a07ec7fecb1f5","created_at":"2026-08-13T13:18:03.256Z","trace_propagation_headers":{"sentry-trace":"21ea5cc1a50d473ebf838696a26b6054-6bffae6cffec4bb7","baggage":"sentry-trace_id=21ea5cc1a50d473ebf838696a26b6054,sentry-release=Unknown"},"correlation_id":"01KZXMBJ3ZKNK69GTSZC0SFQ8C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:03.258Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-43d1eedd4c3a07ec7fecb1f5: start","job_status":"start","queue_duration_s":0.066779,"scheduling_latency_s":0.066813}2519gitlab # [ 318.795969] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:03.369Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"43d1eedd4c3a07ec7fecb1f5","created_at":"2026-08-13T13:18:03.256Z","trace_propagation_headers":{"sentry-trace":"21ea5cc1a50d473ebf838696a26b6054-6bffae6cffec4bb7","baggage":"sentry-trace_id=21ea5cc1a50d473ebf838696a26b6054,sentry-release=Unknown"},"correlation_id":"01KZXMBJ3ZKNK69GTSZC0SFQ8C","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:03.258Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-43d1eedd4c3a07ec7fecb1f5: done: 0.044212 sec","job_status":"done","queue_duration_s":0.066779,"scheduling_latency_s":0.066813,"redis_calls":7,"redis_duration_s":0.001919,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001292,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000627,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044212,"completed_at":"2026-08-13T13:18:03.369Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2520gitlab # [ 318.895049] nixbot[2948]: INFO: ::ffff:127.0.0.1:50888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 200 OK2521gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=87abee05220de882b3af755e55d7910f1b8d5780', in 1.49 seconds)2522[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '87abee05220de882b3af755e55d7910f1b8d5780', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-13T13:18:02.362307Z', 'started_at': '2026-08-13T13:18:02.743160Z', 'finished_at': None}]2523(finished: subtest: push delivers the webhook, in 74.28 seconds)2524subtest: eval and build post commit statuses2525gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/87abee05220de882b3af755e55d7910f1b8d5780/statuses2526gitlab # [ 318.940328] nix-daemon[3176]: accepted connection from pid 3836, user nixbot2527gitlab # [ 318.968388] gitaly[914]: time="2026-08-13T13:18:04.666Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBMAGHQGQR5BW41NS2Y1J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:18:34.265" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:04.665" grpc.time_ms=0.665 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2528gitlab # [ 318.991695] nix-daemon[3176]: accepted connection from pid 3852, user nixbot2529gitlab # [ 318.994609] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:04 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/87abee05220de882b3af755e55d7910f1b8d5780/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 672530gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/87abee05220de882b3af755e55d7910f1b8d5780/statuses, in 0.09 seconds)2531[{'id': 5, 'sha': '87abee05220de882b3af755e55d7910f1b8d5780', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-13T13:18:02.711Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2532gitlab # [ 319.001113] nix-daemon[3176]: accepted connection from pid 3836, user nixbot2533gitlab # [ 319.070882] gitaly[914]: time="2026-08-13T13:18:04.768Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBMDHCT5YNWNMY41T9J0D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:18:34.367" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:04.767" grpc.time_ms=0.559 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2534gitlab # [ 319.102943] gitaly[914]: time="2026-08-13T13:18:04.800Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMBMDHCT5YNWNMY41T9J0D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:18:14.105" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:04.796" grpc.time_ms=4.667 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2535gitlab # [ 319.134485] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:04.831Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"45c2fab9ba31d24dca882b70","created_at":"2026-08-13T13:18:04.828Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-cda84d0cd33c4f70","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:04.830Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-45c2fab9ba31d24dca882b70: start","job_status":"start","queue_duration_s":0.001302,"scheduling_latency_s":0.001332}2536gitlab # [ 319.167767] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 1432537gitlab # [ 319.168832] nixbot[2948]: {"ts": "2026-08-13T13:18:04.866Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/87abee05220de882b3af755e55d7910f1b8d5780 \"HTTP/1.1 201 Created\""}2538gitlab # [ 319.233189] gitaly[914]: time="2026-08-13T13:18:04.931Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBMJ57H6ETSF9W9VM8RJ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:18:34.529" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:04.930" grpc.time_ms=0.591 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2539gitlab # [ 319.271230] gitaly[914]: time="2026-08-13T13:18:04.968Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMBMJ57H6ETSF9W9VM8RJ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:18:14.269" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:04.960" grpc.time_ms=8.655 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2540gitlab # [ 319.272091] gitaly[914]: time="2026-08-13T13:18:04.969Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXMBMDHCT5YNWNMY41T9J0D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:18:04.969" grpc.time_ms=0.495 pid=914 span.kind=server system=grpc2541gitlab # [ 319.313925] gitaly[914]: time="2026-08-13T13:18:05.011Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXMBMDHCT5YNWNMY41T9J0D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3889 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:18:05.011" grpc.time_ms=0.42 pid=914 span.kind=server system=grpc2542gitlab # [ 319.326847] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1542543gitlab # [ 319.327841] nixbot[2948]: {"ts": "2026-08-13T13:18:05.025Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/87abee05220de882b3af755e55d7910f1b8d5780 \"HTTP/1.1 201 Created\""}2544gitlab # [ 319.352125] gitaly[914]: time="2026-08-13T13:18:05.050Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZXMBMDHCT5YNWNMY41T9J0D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-13T13:18:05.049" grpc.time_ms=0.327 pid=914 span.kind=server system=grpc2545gitlab # [ 319.365743] gitaly[914]: time="2026-08-13T13:18:05.063Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBMDHCT5YNWNMY41T9J0D forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T13:18:34.829" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:04.930" operations="[repack_refs]" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2546gitlab # [ 319.367919] gitaly[914]: time="2026-08-13T13:18:05.065Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBMDHCT5YNWNMY41T9J0D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T13:18:34.829" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:04.930" pid=914 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-13 13:16:44.133787787 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2547gitlab # [ 319.385413] gitaly[914]: time="2026-08-13T13:18:05.083Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBMDHCT5YNWNMY41T9J0D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T13:18:34.829" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:04.930" pid=914 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2548gitlab # [ 319.386887] gitaly[914]: time="2026-08-13T13:18:05.083Z" level=info msg="optimized repository" clean_stale_data_time=16.900751ms clean_work_trees_time="167.061µs" commit_graph_time="8.101µs" correlation_id=01KZXMBMDHCT5YNWNMY41T9J0D gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="16.203µs" pid=914 prune_time="20.114µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="14.806µs" storage_name=default system=housekeeping total_time=17.443278ms2549gitlab # [ 319.387879] gitaly[914]: time="2026-08-13T13:18:05.084Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBMDHCT5YNWNMY41T9J0D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T13:18:34.829" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:04.930" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2550gitlab # [ 319.389830] gitaly[914]: time="2026-08-13T13:18:05.087Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBMQB150S0XD10WHBH90D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:18:35.086" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:05.087" grpc.time_ms=0.42 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2551gitlab # [ 319.419249] gitaly[914]: time="2026-08-13T13:18:05.117Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMBMQB150S0XD10WHBH90D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-13T13:18:15.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:05.113" grpc.time_ms=3.956 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2552gitlab # [ 319.462774] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/87abee05220de882b3af755e55d7910f1b8d5780 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1242553gitlab # [ 319.463666] gitaly[914]: time="2026-08-13T13:18:05.160Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBMDHCT5YNWNMY41T9J0D diskcache=93d3d5cb-09b9-48bb-835d-723cc28491dc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T13:18:34.829" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:04.930" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2554gitlab # [ 319.464668] gitaly[914]: time="2026-08-13T13:18:05.160Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=128 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=8564 command.oublock=0 command.real_time_ms=144 command.spawn_token_fork_ms=3 command.system_time_ms=93 command.user_time_ms=35 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBMDHCT5YNWNMY41T9J0D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-13T13:18:34.829" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-13T13:18:04.930" grpc.time_ms=230.325 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2555gitlab # [ 319.465765] nixbot[2948]: {"ts": "2026-08-13T13:18:05.161Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/87abee05220de882b3af755e55d7910f1b8d5780 \"HTTP/1.1 201 Created\""}2556gitlab # [ 319.520483] nix-daemon[3176]: accepted connection from pid 3900, user nixbot2557gitlab # [ 319.558123] gitaly[914]: time="2026-08-13T13:18:05.255Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMBMDHCT5YNWNMY41T9J0D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-13T13:18:35.154" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:05.255" grpc.time_ms=0.711 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2558gitlab # [ 319.589768] gitaly[914]: time="2026-08-13T13:18:05.287Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZXMBMDHCT5YNWNMY41T9J0D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-13T13:18:35.185" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-13T13:18:05.285" grpc.time_ms=0.795 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2559gitlab # [ 319.601307] gitaly[914]: time="2026-08-13T13:18:05.299Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZXMBMXX29P9DCM8ZAMX9370 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-13T13:18:05.293" grpc.time_ms=5.824 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2560gitlab # [ 319.602785] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/13:13:18:05 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 542561gitlab # [ 319.603874] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.301Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"9d647d14072c6bbe272cf85b","created_at":"2026-08-13T13:18:05.298Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-842ffef0d2774b73","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"45c2fab9ba31d24dca882b70","job_size_bytes":3,"pid":2979,"job_status":"deduplicated","message":"PipelineProcessWorker JID-9d647d14072c6bbe272cf85b: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2562gitlab # [ 319.606782] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.304Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"45c2fab9ba31d24dca882b70","created_at":"2026-08-13T13:18:04.828Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-cda84d0cd33c4f70","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:04.830Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2979,"job_status":"rescheduled","message":"PipelineProcessWorker JID-45c2fab9ba31d24dca882b70: rescheduled"}2563gitlab # [ 319.612966] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.310Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"45c2fab9ba31d24dca882b70","created_at":"2026-08-13T13:18:04.828Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-cda84d0cd33c4f70","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:04.830Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-45c2fab9ba31d24dca882b70: done: 0.478637 sec","job_status":"done","queue_duration_s":0.001302,"scheduling_latency_s":0.001332,"gitaly_calls":3,"gitaly_duration_s":0.274304,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.019327999999999998,"redis_read_bytes":239,"redis_write_bytes":21779,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001349,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001316,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.00515,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14464,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.006767,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000437,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000638,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002322,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.142345,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.428227051,"duration_s":0.478637,"completed_at":"2026-08-13T13:18:05.310Z","load_balancing_strategy":"primary","db_duration_s":0.036007,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2564gitlab # [ 319.676561] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.313Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"1fdbd3e577d1d6e6038fd0e5","created_at":"2026-08-13T13:18:04.918Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-842ffef0d2774b73","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:04.923Z","job_size_bytes":23,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-1fdbd3e577d1d6e6038fd0e5: start","job_status":"start","queue_duration_s":0.389865,"scheduling_latency_s":0.389887}2565gitlab # [ 319.732725] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.349Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"1fdbd3e577d1d6e6038fd0e5","created_at":"2026-08-13T13:18:04.918Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-842ffef0d2774b73","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:04.923Z","job_size_bytes":23,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-1fdbd3e577d1d6e6038fd0e5: done: 0.035987 sec","job_status":"done","queue_duration_s":0.389865,"scheduling_latency_s":0.389887,"redis_calls":7,"redis_duration_s":0.001547,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001116,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035987,"completed_at":"2026-08-13T13:18:05.349Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006796,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2566gitlab # [ 319.742108] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.350Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f980a21d3f796bc54042dec9","created_at":"2026-08-13T13:18:05.199Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-842ffef0d2774b73","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.201Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f980a21d3f796bc54042dec9: start","job_status":"start","queue_duration_s":0.149103,"scheduling_latency_s":0.149124}2567gitlab # [ 319.816279] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.377Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f980a21d3f796bc54042dec9","created_at":"2026-08-13T13:18:05.199Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-842ffef0d2774b73","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.201Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f980a21d3f796bc54042dec9: done: 0.026657 sec","job_status":"done","queue_duration_s":0.149103,"scheduling_latency_s":0.149124,"redis_calls":7,"redis_duration_s":0.001707,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026657,"completed_at":"2026-08-13T13:18:05.377Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004301,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2568gitlab # [ 319.873079] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.379Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"93ace174d4ab54cbb34ac543","created_at":"2026-08-13T13:18:05.209Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-842ffef0d2774b73","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.211Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-93ace174d4ab54cbb34ac543: start","job_status":"start","queue_duration_s":0.167799,"scheduling_latency_s":0.167823}2569gitlab # [ 319.873993] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.408Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"93ace174d4ab54cbb34ac543","created_at":"2026-08-13T13:18:05.209Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-842ffef0d2774b73","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.211Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-93ace174d4ab54cbb34ac543: done: 0.028969 sec","job_status":"done","queue_duration_s":0.167799,"scheduling_latency_s":0.167823,"redis_calls":7,"redis_duration_s":0.001952,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001372,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00058,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028969,"completed_at":"2026-08-13T13:18:05.408Z","load_balancing_strategy":"primary","db_duration_s":0.004612,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2570gitlab # [ 319.892096] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.412Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"a5eecdcdfd3ee86476b94a7b","created_at":"2026-08-13T13:18:05.220Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-842ffef0d2774b73","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.223Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a5eecdcdfd3ee86476b94a7b: start","job_status":"start","queue_duration_s":0.189323,"scheduling_latency_s":0.189362}2571gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/87abee05220de882b3af755e55d7910f1b8d5780/statuses2572gitlab # [ 319.910177] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.447Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"a5eecdcdfd3ee86476b94a7b","created_at":"2026-08-13T13:18:05.220Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-842ffef0d2774b73","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.223Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a5eecdcdfd3ee86476b94a7b: done: 0.035395 sec","job_status":"done","queue_duration_s":0.189323,"scheduling_latency_s":0.189362,"redis_calls":10,"redis_duration_s":0.003509,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001653,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000539,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035395,"completed_at":"2026-08-13T13:18:05.447Z","load_balancing_strategy":"primary","db_duration_s":0.004137,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2573gitlab # [ 319.965124] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.449Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4903b79a75da2a9aa77996e0","created_at":"2026-08-13T13:18:05.223Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-842ffef0d2774b73","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.226Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4903b79a75da2a9aa77996e0: start","job_status":"start","queue_duration_s":0.223524,"scheduling_latency_s":0.223557}2574gitlab # [ 319.980242] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.480Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"4903b79a75da2a9aa77996e0","created_at":"2026-08-13T13:18:05.223Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-842ffef0d2774b73","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.226Z","job_size_bytes":3,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-4903b79a75da2a9aa77996e0: done: 0.030863 sec","job_status":"done","queue_duration_s":0.223524,"scheduling_latency_s":0.223557,"redis_calls":7,"redis_duration_s":0.001983,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001221,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000762,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030863,"completed_at":"2026-08-13T13:18:05.480Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2575gitlab # [ 320.039828] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.482Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"da8e924b493b1a1691677f3c","created_at":"2026-08-13T13:18:05.226Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-842ffef0d2774b73","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.229Z","job_size_bytes":19,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-da8e924b493b1a1691677f3c: start","job_status":"start","queue_duration_s":0.252726,"scheduling_latency_s":0.252749}2576gitlab # [ 320.101759] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.504Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"da8e924b493b1a1691677f3c","created_at":"2026-08-13T13:18:05.226Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-842ffef0d2774b73","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.229Z","job_size_bytes":19,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-da8e924b493b1a1691677f3c: done: 0.022744 sec","job_status":"done","queue_duration_s":0.252726,"scheduling_latency_s":0.252749,"redis_calls":8,"redis_duration_s":0.00165,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001278,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000372,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022744,"completed_at":"2026-08-13T13:18:05.504Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2577gitlab # [ 320.103831] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.506Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9c4dfad7112febdb377dea00","created_at":"2026-08-13T13:18:05.230Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-842ffef0d2774b73","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.232Z","job_size_bytes":66,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9c4dfad7112febdb377dea00: start","job_status":"start","queue_duration_s":0.273097,"scheduling_latency_s":0.273204}2578gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/87abee05220de882b3af755e55d7910f1b8d5780/statuses, in 0.19 seconds)2579[{'id': 5, 'sha': '87abee05220de882b3af755e55d7910f1b8d5780', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-13T13:18:02.711Z', 'started_at': None, 'finished_at': '2026-08-13T13:18:04.821Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '87abee05220de882b3af755e55d7910f1b8d5780', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-13T13:18:04.993Z', 'started_at': None, 'finished_at': '2026-08-13T13:18:05.138Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2580(finished: subtest: eval and build post commit statuses, in 1.28 seconds)2581(finished: run the VM test script, in 434.37 seconds)2582test script finished in 434.39s2583cleanup2584kill QemuMachine (pid 46)2585gitlab # [ 320.159552] sidekiq-cluster[2979]: {"severity":"INFO","time":"2026-08-13T13:18:05.529Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9c4dfad7112febdb377dea00","created_at":"2026-08-13T13:18:05.230Z","trace_propagation_headers":{"sentry-trace":"e88f020d42944786aa2ae9599145f2a2-842ffef0d2774b73","baggage":"sentry-trace_id=e88f020d42944786aa2ae9599145f2a2,sentry-release=Unknown"},"correlation_id":"01KZXMBMDHCT5YNWNMY41T9J0D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-13T13:18:05.232Z","job_size_bytes":66,"pid":2979,"sidekiq_tid":"m8dz","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9c4dfad7112febdb377dea00: done: 0.02364 sec","job_status":"done","queue_duration_s":0.273097,"scheduling_latency_s":0.273204,"redis_calls":7,"redis_duration_s":0.001493,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000376,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_rqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2586gitlab # e2587(finished: cleanup, in 1.60 seconds)