vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #374
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.v0cDXlZcAk', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: 79e63d0f-3667-4a56-819e-200cf3e39a1916gitlab # Superblock backups stored on blocks:17(finished: start all VMs, in 48.71 seconds)18gitlab # 32768, 98304, 163840, 22937619gitlab # 20gitlab: waiting for unit setup-gitlab.service21gitlab # Allocating group tables: 0/8 done22gitlab: waiting for the VM to finish booting23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/q5663fr0rvinpgcgy2g6gs5fjliy06kg-nixos-system-gitlab-test/init regInfo=/nix/store/mmgxlan1ca2nv01c8hrd9xnx43q6wph1-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000001] kvm-clock: using sched offset of 440454399 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor67gitlab # [ 0.000811] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000878] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002733] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002744] Using GB pages for direct mapping73gitlab # [ 0.002789] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002797] ACPI: Early table checksum verification disabled75gitlab # [ 0.002800] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002804] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002808] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002815] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002817] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002818] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002820] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002821] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002823] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002824] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002824] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002825] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002825] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002826] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003094] No NUMA configuration found90gitlab # [ 0.003095] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003097] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005497] Zone ranges:93gitlab # [ 0.005498] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005500] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005501] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005502] Device empty97gitlab # [ 0.005503] Movable zone start for each node98gitlab # [ 0.005504] Early memory node ranges99gitlab # [ 0.005504] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005505] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005506] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005507] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005526] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005794] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.115292] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.115728] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.115744] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.115781] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.115784] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.115786] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.115787] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.115788] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.115789] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.115791] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.115793] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.115797] TSC deadline timer available117gitlab # [ 0.115802] CPU topo: Max. logical packages: 1118gitlab # [ 0.115803] CPU topo: Max. logical dies: 1119gitlab # [ 0.115803] CPU topo: Max. dies per package: 1120gitlab # [ 0.115809] CPU topo: Max. threads per core: 1121gitlab # [ 0.115809] CPU topo: Num. cores per package: 4122gitlab # [ 0.115810] CPU topo: Num. threads per package: 4123gitlab # [ 0.115810] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.115836] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.115854] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.115857] kvm-guest: setup PV sched yield127gitlab # [ 0.115872] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.115874] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.115874] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.115876] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.115878] Booting paravirtualized kernel on KVM132gitlab # [ 0.115882] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.120334] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.122562] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.122611] kvm-guest: PV spinlocks enabled136gitlab # [ 0.122613] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.122616] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/q5663fr0rvinpgcgy2g6gs5fjliy06kg-nixos-system-gitlab-test/init regInfo=/nix/store/mmgxlan1ca2nv01c8hrd9xnx43q6wph1-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.122715] Unknown kernel command line parameters "regInfo=/nix/store/mmgxlan1ca2nv01c8hrd9xnx43q6wph1-closure-info/registration", will be passed to user space.139gitlab # [ 0.122728] random: crng init done140gitlab # [ 0.122729] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.131615] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.135937] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.136016] software IO TLB: area num 4.144gitlab # [ 0.212314] Fallback order for Node 0: 0145gitlab # [ 0.212323] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.212325] Policy zone: Normal147gitlab # [ 0.214890] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.225285] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.239028] allocated 12582912 bytes of page_ext150gitlab # [ 0.249493] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.249496] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.250338] Dynamic Preempt: lazy153gitlab # [ 0.250527] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.250528] rcu: RCU event tracing is enabled.155gitlab # [ 0.250529] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.250530] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.250531] Rude variant of Tasks RCU enabled.158gitlab # [ 0.250531] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.250532] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.250533] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.250553] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.250555] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.250556] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.254946] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.255232] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.255242] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.255358] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.258934] Console: colour VGA+ 80x25169gitlab # [ 0.258937] printk: legacy console [tty0] enabled170gitlab # [ 0.289142] printk: legacy console [ttyS0] enabled171gitlab # [ 0.396769] ACPI: Core revision 20250807172gitlab # [ 0.397754] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.399354] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.400368] x2apic enabled175gitlab # [ 0.401119] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.402068] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.403295] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.404850] kvm-guest: setup PV IPIs179gitlab # [ 0.406425] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.407471] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns181gitlab # [ 0.409206] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)182gitlab # [ 0.411290] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.412324] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.414202] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.415207] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.416203] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.418203] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.419202] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.420202] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.421202] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.422210] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.423780] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.425203] active return thunk: srso_alias_return_thunk194gitlab # [ 0.426233] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.427202] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.428202] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.429202] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.430202] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.431202] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.432202] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.434203] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.435202] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.436202] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.437202] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.438203] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.439202] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.469555] Freeing SMP alternatives memory: 44K208gitlab # [ 0.470206] pid_max: default: 32768 minimum: 301209gitlab # [ 0.471320] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.472309] landlock: Up and running.211gitlab # [ 0.472956] Yama: becoming mindful.212gitlab # [ 0.473871] LSM support for eBPF active213gitlab # [ 0.474453] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.476360] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.478948] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.479737] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.480207] ... version: 2218gitlab # [ 0.480951] ... bit width: 48219gitlab # [ 0.481205] ... generic counters: 6220gitlab # [ 0.481961] ... generic bitmap: 000000000000003f221gitlab # [ 0.482260] ... fixed-purpose counters: 0222gitlab # [ 0.483003] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.483918] ... value mask: 0000ffffffffffff224gitlab # [ 0.484204] ... max period: 00007fffffffffff225gitlab # [ 0.485133] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.486062] signal: max sigframe size: 3376227gitlab # [ 0.486829] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.487209] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.488283] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.493747] smp: Bringing up secondary CPUs ...231gitlab # [ 0.494613] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.495214] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.498367] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.500205] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)235gitlab # [ 0.501547] Memory: 6011376K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260104K reserved, 0K cma-reserved)236gitlab # [ 0.504206] devtmpfs: initialized237gitlab # [ 0.505327] x86/mm: Memory block size: 128MB238gitlab # [ 0.508384] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.509286] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.510309] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.511553] PM: RTC time: 10:45:06, date: 2026-09-13242gitlab # [ 0.515230] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.517842] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.518272] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.520339] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.521218] audit: initializing netlink subsys (disabled)247gitlab # [ 0.522265] audit: type=2000 audit(1789296307.040:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.522532] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.524205] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.525206] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.526205] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.527205] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.528220] cpuidle: using governor menu254gitlab # [ 0.530427] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.531436] PCI: Using configuration type 1 for base access256gitlab # [ 0.532205] PCI: Using configuration type 1 for extended access257gitlab # [ 0.533325] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.536266] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.537207] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.538205] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.539206] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.544036] ACPI: Added _OSI(Module Device)263gitlab # [ 0.546213] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.548211] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.555184] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.562762] ACPI: Interpreter enabled267gitlab # [ 0.564266] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.565211] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.567296] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.571215] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.573552] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.587470] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.589222] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.592913] acpiphp: Slot [3] registered275gitlab # [ 0.594217] acpiphp: Slot [4] registered276gitlab # [ 0.595247] acpiphp: Slot [5] registered277gitlab # [ 0.597264] acpiphp: Slot [6] registered278gitlab # [ 0.598250] acpiphp: Slot [7] registered279gitlab # [ 0.599249] acpiphp: Slot [8] registered280gitlab # [ 0.601266] acpiphp: Slot [9] registered281gitlab # [ 0.602248] acpiphp: Slot [10] registered282gitlab # [ 0.604256] acpiphp: Slot [11] registered283gitlab # [ 0.605249] acpiphp: Slot [12] registered284gitlab # [ 0.606264] acpiphp: Slot [13] registered285gitlab # [ 0.608249] acpiphp: Slot [14] registered286gitlab # [ 0.609248] acpiphp: Slot [15] registered287gitlab # [ 0.611247] acpiphp: Slot [16] registered288gitlab # [ 0.612236] acpiphp: Slot [17] registered289gitlab # [ 0.612970] acpiphp: Slot [18] registered290gitlab # [ 0.613225] acpiphp: Slot [19] registered291gitlab # [ 0.613956] acpiphp: Slot [20] registered292gitlab # [ 0.615235] acpiphp: Slot [21] registered293gitlab # [ 0.615952] acpiphp: Slot [22] registered294gitlab # [ 0.616225] acpiphp: Slot [23] registered295gitlab # [ 0.616974] acpiphp: Slot [24] registered296gitlab # [ 0.618227] acpiphp: Slot [25] registered297gitlab # [ 0.618943] acpiphp: Slot [26] registered298gitlab # [ 0.619225] acpiphp: Slot [27] registered299gitlab # [ 0.619977] acpiphp: Slot [28] registered300gitlab # [ 0.620232] acpiphp: Slot [29] registered301gitlab # [ 0.620958] acpiphp: Slot [30] registered302gitlab # [ 0.622226] acpiphp: Slot [31] registered303gitlab # [ 0.622959] PCI host bridge to bus 0000:00304gitlab # [ 0.623220] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.625206] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.626205] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.627208] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.628266] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.632238] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.635229] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.639662] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.644268] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.650282] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.653279] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.655211] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.658210] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.660211] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.663703] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.669389] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.674816] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.677724] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.680221] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.682646] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.700201] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.701219] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.702215] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.704352] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.706307] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.716229] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.718226] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.720266] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.750226] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.755450] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.764224] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.765212] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.766229] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.768471] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.773231] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.774189] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.774992] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.777890] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.783215] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.784110] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.785005] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.787419] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.795225] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.798222] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.800252] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.803536] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.807213] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.808212] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.809216] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.812445] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.815224] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.816128] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.817009] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.818212] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.820467] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.823212] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.824234] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.826438] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.830224] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.831111] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.831995] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.834439] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.838222] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.840254] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.841235] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.847255] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.848366] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.849352] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.850351] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.851291] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.854746] iommu: Default domain type: Translated375gitlab # [ 0.855864] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.857517] ACPI: bus type USB registered377gitlab # [ 0.858330] usbcore: registered new interface driver usbfs378gitlab # [ 0.859241] usbcore: registered new interface driver hub379gitlab # [ 0.861230] usbcore: registered new device driver usb380gitlab # [ 0.864334] NetLabel: Initializing381gitlab # [ 0.866210] NetLabel: domain hash size = 128382gitlab # [ 0.867208] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.869361] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.871216] PCI: Using ACPI for IRQ routing385gitlab # [ 0.872459] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.873201] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.873201] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.875211] vgaarb: loaded389gitlab # [ 0.875982] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.877206] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.882319] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.885919] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.886673] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.888169] pnp: PnP ACPI init395gitlab # [ 0.889343] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.899349] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.900954] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.902080] NET: Registered PF_INET protocol family399gitlab # [ 0.904253] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.922905] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.924565] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.928029] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.936906] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.940203] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.943421] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.947368] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.950756] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.954217] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.956537] NET: Registered PF_XDP protocol family410gitlab # [ 0.958677] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.961192] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.963671] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.966385] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.969144] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.971951] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.973890] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.978713] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.983628] PCI: CLS 0 bytes, default 64419gitlab # [ 0.985151] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.985550] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.985591] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.990569] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns423gitlab # [ 1.038857] Initialise system trusted keyrings424gitlab # [ 1.041093] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.062280] Key type asymmetric registered426gitlab # [ 1.063051] Asymmetric key parser 'x509' registered427gitlab # [ 1.064019] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.065620] io scheduler mq-deadline registered429gitlab # [ 1.066425] io scheduler kyber registered430gitlab # [ 1.070443] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.071789] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.074392] Linux agpgart interface v0.103433gitlab # [ 1.075189] ACPI: bus type drm_connector registered434gitlab # [ 1.078452] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.079580] usbserial: USB Serial support registered for generic436gitlab # [ 1.080600] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.080600] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.082934] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.084451] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.085699] NET: Registered PF_INET6 protocol family441gitlab # [ 1.087609] Segment Routing with IPv6442gitlab # [ 1.088315] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.090296] IPI shorthand broadcast: enabled444gitlab # [ 1.094625] sched_clock: Marking stable (948015267, 145959711)->(1112844205, -18869227)445gitlab # [ 1.096468] registered taskstats version 1446gitlab # [ 1.097492] Loading compiled-in X.509 certificates447gitlab # [ 1.107485] Demotion targets for Node 0: null448gitlab # [ 1.108508] Key type .fscrypt registered449gitlab # [ 1.109217] Key type fscrypt-provisioning registered450gitlab # [ 1.110214] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.111160] ima: Allocated hash algorithm: sha1452gitlab # [ 1.111998] ima: No architecture policies found453gitlab # [ 1.113101] PM: Magic number: 10:291:780454gitlab # [ 1.114830] RAS: Correctable Errors collector initialized.455gitlab # [ 1.119397] clk: Disabling unused clocks456gitlab # [ 1.120122] PM: genpd: Disabling unused power domains457gitlab # [ 1.250284] Freeing initrd memory: 29392K458gitlab # [ 1.257839] Freeing unused decrypted memory: 2028K459gitlab # [ 1.264352] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.267063] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.271952] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.275786] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.341839] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.343031] Run /init as init process465gitlab # [ 1.354677] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.376595] fuse: init (API version 7.45)467gitlab # [ 1.384801] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.391031] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.394068] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.428710] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.765486] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.805186] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.807319] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.809440] systemd[1]: Running in initrd.475gitlab # [ 1.811904] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.815009] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.924174] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.983496] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 1.993699] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 1.994889] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 1.996318] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 1.997467] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 1.998584] systemd[1]: Reached target Path Units.484gitlab # [ 1.999483] systemd[1]: Reached target Slice Units.485gitlab # [ 2.000377] systemd[1]: Reached target Swaps.486gitlab # [ 2.001271] systemd[1]: Reached target Timer Units.487gitlab # [ 2.002425] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 2.003676] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 2.004883] systemd[1]: Listening on Journal Sockets.490gitlab # [ 2.005908] systemd[1]: Listening on udev Control Socket.491gitlab # [ 2.006945] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 2.007922] systemd[1]: Reached target Socket Units.493gitlab # [ 2.010068] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 2.012278] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.014288] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.020173] systemd[1]: Starting Journal Service...497gitlab # [ 2.024009] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.026019] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.028533] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.033167] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.036701] systemd[1]: modprobe@configfs.service: Deactivated successfully.502gitlab # [ 2.038270] systemd[1]: Finished Load Kernel Module configfs.503gitlab # [ 2.043363] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config504gitlab # [ 2.049888] systemd-journald[92]: Collecting audit messages is disabled.505gitlab # [ 2.052046] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...506gitlab # [ 2.068305] netfs: FS-Cache loaded507gitlab # [ 2.070477] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.508gitlab # [ 2.075339] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.509gitlab # [ 2.078211] systemd[1]: Starting Create Static Device Nodes in /dev...510gitlab # [ 2.081326] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev511gitlab # [ 2.081621] 9pnet: Installing 9P2000 support512gitlab # [ 2.088336] systemd[1]: Finished Load Kernel Modules.513gitlab # [ 2.089912] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.514gitlab # [ 2.091659] systemd[1]: Finished Load Kernel Module 9pnet_virtio.515gitlab # [ 2.094281] systemd[1]: Starting Apply Kernel Variables...516gitlab # [ 2.096093] systemd[1]: Finished Create Static Device Nodes in /dev.517gitlab # [ 2.097440] systemd[1]: Reached target Preparation for Local File Systems.518gitlab # [ 2.098706] systemd[1]: Reached target Local File Systems.519gitlab # [ 1.959340] systemd-modules-load[94]: Using 4 probe threads520gitlab # [ 1.960707] systemd-modules-load[94]: Inserted module 'virtio_balloon'521gitlab # [ 1.961720] systemd-modules-load[94]: Inserted module 'virtio_gpu'522gitlab # [ 1.962752] systemd-modules-load[94]: Inserted module 'dm_mod'523gitlab # [ 2.110253] systemd[1]: Starting Rule-based Manager for Device Events and Files...524gitlab # [ 2.111512] systemd[1]: Started Journal Service.525gitlab # [ 1.972611] systemd[1]: Finished Apply Kernel Variables.526gitlab # [ 1.977069] systemd[1]: Starting Create System Files and Directories...527gitlab # [ 1.989153] systemd-udevd[105]: Using default interface naming scheme 'v261'.528gitlab # [ 1.990501] systemd[1]: Finished Create System Files and Directories.529gitlab # [ 2.001359] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.017521] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.018527] systemd[1]: Reached target System Initialization.532gitlab # [ 2.019393] systemd[1]: Reached target Basic System.533gitlab # [ 2.274600] SCSI subsystem initialized534gitlab # [ 2.285000] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12535gitlab # [ 2.287295] serio: i8042 KBD port at 0x60,0x64 irq 1536gitlab # [ 2.288104] serio: i8042 AUX port at 0x60,0x64 irq 12537gitlab # [ 2.291790] uhci_hcd 0000:00:01.2: UHCI Host Controller538gitlab # [ 2.292984] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1539gitlab # [ 2.294155] uhci_hcd 0000:00:01.2: detected 2 ports540gitlab # [ 2.298149] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140541gitlab # [ 2.300910] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18542gitlab # [ 2.302251] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1543gitlab # [ 2.303438] usb usb1: Product: UHCI Host Controller544gitlab # [ 2.304227] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd545gitlab # [ 2.305004] usb usb1: SerialNumber: 0000:00:01.2546gitlab # [ 2.308614] hub 1-0:1.0: USB hub found547gitlab # [ 2.309266] hub 1-0:1.0: 2 ports detected548gitlab # [ 2.311436] virtio_blk virtio4: 4/0/0 default/read/poll queues549gitlab # [ 2.314854] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)550gitlab # [ 2.318336] virtio_blk virtio5: 4/0/0 default/read/poll queues551gitlab # [ 2.318738] scsi host0: ata_piix552gitlab # [ 2.320154] scsi host1: ata_piix553gitlab # [ 2.320839] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0554gitlab # [ 2.322498] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0555gitlab # [ 2.325630] virtio_blk virtio5: [vdb] 11843368 512-byte logical blocks (6.06 GB/5.65 GiB)556gitlab # [ 2.205881] (udev-worker)[119]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.207911] (udev-worker)[126]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.558gitlab # [ 2.210216] (udev-worker)[126]: Network interface NamePolicy= disabled on kernel command line.559gitlab # [ 2.212940] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 2.232152] systemd-vconsole-setup[152]: Configuration of first virtual console was skipped, ignoring remaining ones.561gitlab # [ 2.233797] systemd[1]: Finished Virtual Console Setup.562gitlab # [ 2.481507] ata2: found unknown device (class 0)563gitlab # [ 2.483823] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100564gitlab # [ 2.487652] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5565gitlab # [ 2.521764] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0566gitlab # [ 2.538296] usb 1-1: new full-speed USB device number 2 using uhci_hcd567gitlab # [ 2.397545] systemd[1]: Found device /dev/disk/by-label/nixos.568gitlab # [ 2.403361] systemd[1]: Found device /dev/disk/by-label/nix-store.569gitlab # [ 2.405408] systemd[1]: Reached target Initrd Root Device.570gitlab # [ 2.407226] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...571gitlab # [ 2.559142] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray572gitlab # [ 2.447008] systemd-fsck[159]: nixos: clean, 12/65536 files, 13019/262144 blocks573gitlab # [ 2.453854] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.574gitlab # [ 2.603708] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.704782] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.707693] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.710261] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.711876] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.713357] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.745605] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.759763] usbcore: registered new interface driver usbhid582gitlab # [ 2.761817] usbhid: USB HID core driver583gitlab # [ 2.771337] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.774660] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.887588] systemd[1]: Mounting /sysroot...586gitlab # [ 3.173716] EXT4-fs (vda): mounted filesystem 79e63d0f-3667-4a56-819e-200cf3e39a19 r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.032573] systemd[1]: Mounted /sysroot.588gitlab # [ 3.034418] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.036730] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.038695] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.040691] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.048437] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.053095] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.059162] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.061270] systemd[1]: Mounted /sysroot/nix/.rw-store.596gitlab # [ 3.063096] systemd[1]: Mounted /sysroot/run.597gitlab # [ 3.211919] 9p: Installing v9fs 9p2000 file system support598gitlab # [ 3.069398] systemd[1]: Starting rw-sysroot-nix-store.service...599gitlab # [ 3.074487] systemd[1]: Mounted /sysroot/tmp/shared.600gitlab # [ 3.223301] erofs (device vdb): mounted with root inode @ nid 128.601gitlab # [ 3.079928] systemd[1]: Mounted /sysroot/nix/.ro-store.602gitlab # [ 3.081341] systemd-sysroot-fstab-check[178]: /sysroot should be mounted in the initrd, will request daemon-reload.603gitlab # [ 3.083690] systemd[1]: Reload requested from client PID 178 ('systemd-sysroot') (unit initrd-parse-etc.service)...604gitlab # [ 3.086373] systemd[1]: Reloading...605gitlab # [ 3.142329] systemd[1]: Reloading finished in 60 ms.606gitlab # [ 3.166564] systemd-sysroot-fstab-check[178]: Requesting initrd-fs.target/start/replace...607gitlab # [ 3.170051] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.171283] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.173222] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.175469] systemd-sysroot-fstab-check[178]: Requesting swap.target/start/replace...611gitlab # [ 3.179443] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.181739] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.184144] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.186381] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.194678] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.196686] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.888197] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 3.921761] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 3.922874] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 3.924812] systemd[1]: Starting Find NixOS closure...621gitlab # [ 3.926488] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 3.946462] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 3.947969] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 3.966523] systemd[1]: Finished Find NixOS closure.625gitlab # [ 3.967713] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 3.969198] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 3.988482] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 3.989706] systemd[1]: Stopped target Basic System.629gitlab # [ 3.990843] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 3.992067] systemd[1]: Stopped target Path Units.631gitlab # [ 3.993196] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 3.994590] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 3.996145] systemd[1]: Stopped target Slice Units.634gitlab # [ 3.997291] systemd[1]: Stopped target Socket Units.635gitlab # [ 3.998387] systemd[1]: Stopped target System Initialization.636gitlab # [ 3.999556] systemd[1]: Stopped target Swaps.637gitlab # [ 4.001454] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.002555] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.005219] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.006447] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.007811] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.008903] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.011316] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.012785] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.014596] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.015678] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.017119] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.018170] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.019398] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.020731] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.021967] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.023171] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.024244] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.025385] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.026590] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.027568] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.028861] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.030050] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.030995] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.032504] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.033623] systemd[1]: systemd-udevd.service: Deactivated successfully.662gitlab # [ 4.034769] systemd[1]: Stopped Rule-based Manager for Device Events and Files.663gitlab # [ 4.035923] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.664gitlab # [ 4.037102] systemd[1]: Finished rw-sysroot-nix-store.service.665gitlab # [ 4.038042] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.039034] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.039725] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.040433] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.041420] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.042247] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.043317] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.044276] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.045189] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.067770] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.068785] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.069465] systemd[1]: Reached target Switch Root.677gitlab # [ 4.070677] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.151440] initrd-nixos-activation-start[226]: booting system configuration /nix/store/q5663fr0rvinpgcgy2g6gs5fjliy06kg-nixos-system-gitlab-test679gitlab # [ 4.184700] initrd-nixos-activation-start[226]: running activation script...680gitlab # [ 4.405811] initrd-nixos-activation-start[249]: setting up /etc...681gitlab # [ 4.511387] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.513895] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.515478] systemd[1]: Starting Switch Root...684gitlab # [ 4.542170] systemd[1]: Switching root.685gitlab # [ 4.743612] systemd-journald[92]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 4.858013] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.225454] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.234727] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.236659] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.238656] systemd[1]: Detected first boot.691gitlab # [ 5.241244] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.383476] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.466435] systemd[1]: Applying preset policy.694gitlab # [ 5.616308] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.729109] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.730404] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.732432] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.734524] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.736038] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.737564] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.738528] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.740048] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.741308] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.742033] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.742853] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.743771] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.744551] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.745373] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.746271] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.747276] systemd[1]: Reached target Path Units.711gitlab # [ 5.747986] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.748817] systemd[1]: Reached target Slice Units.713gitlab # [ 5.749591] systemd[1]: Reached target Swaps.714gitlab # [ 5.751063] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.753088] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.754464] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.756118] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.757088] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 5.759543] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 5.761044] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 5.763024] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 5.764299] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 5.765485] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 5.766856] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 5.769640] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 5.770702] systemd[1]: Listening on udev Control Socket.727gitlab # [ 5.771665] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 5.774252] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 5.776222] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 5.778356] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 5.780283] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 5.782249] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 5.783319] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 5.787894] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 5.790319] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 5.823061] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 5.827135] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 5.833379] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 5.835158] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 5.842977] systemd[1]: Starting Journal Service...741gitlab # [ 5.846426] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 5.851015] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 5.855017] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 5.855991] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 5.860042] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 5.865837] systemd-journald[319]: Collecting audit messages is enabled.747gitlab # [ 5.866144] systemd[1]: Listening on Journal Log Access Socket.748gitlab # [ 5.867832] systemd[1]: Mounted Huge Pages File System.749gitlab # [ 5.868806] systemd[1]: Mounted POSIX Message Queue File System.750gitlab # [ 5.869956] systemd[1]: Mounted Kernel Debug File System.751gitlab # [ 5.871130] systemd[1]: Mounted Kernel Trace File System.752gitlab # [ 5.872554] systemd[1]: Finished Create List of Static Device Nodes.753gitlab # [ 5.873612] EXT4-fs (vda): re-mounted 79e63d0f-3667-4a56-819e-200cf3e39a19.754gitlab # [ 5.875912] systemd[1]: modprobe@configfs.service: Deactivated successfully.755gitlab # [ 5.876979] loop: module loaded756gitlab # [ 5.731472] systemd[1]: Queued start job for default target M[ 5.877715] systemd[1]: Finished Load Kernel Module configfs.757gitlab # ulti-User System.758gitlab # [ 5.879058] systemd[1]: Started Journal Service.759gitlab # [ 5.733432] systemd[1]: Unnecessary job was removed for /dev/vdb.760gitlab # [ 5.734886] systemd[1]: systemd-journald.service: Deactivated successfully.761gitlab # [ 5.736224] systemd-modules-load[320]: Using 3 probe threads762gitlab # [ 5.737474] systemd-modules-load[320]: Inserted module 'tls'763gitlab # [ 5.738406] systemd[1]: Mounted FUSE Control File System.764gitlab # [ 5.739350] systemd[1]: Finished Remount Root and Kernel File Systems.765gitlab # [ 5.740425] systemd-modules-load[320]: Inserted module 'loop'766gitlab # [ 5.741454] systemd[1]: Listening on Disk Image Download Service Socket.767gitlab # [ 5.742492] systemd[1]: Mounting Kernel Configuration File System...768gitlab # [ 5.746272] systemd[1]: Starting Flush Journal to Persistent Storage...769gitlab # [ 5.747235] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore770gitlab # [ 5.749139] systemd[1]: Starting Load/Save OS Random Seed...771gitlab # [ 5.750829] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...772gitlab # [ 5.753138] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os773gitlab # [ 5.759087] systemd[1]: Finished Load Kernel Modules.774gitlab # [ 5.762107] systemd[1]: Mounted Kernel Configuration File System.775gitlab # [ 5.763465] systemd-oomd[322]: No swap; memory pressure usage will be degraded776gitlab # [ 5.765792] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.777gitlab # [ 5.914160] systemd-journald[319]: Received client request to flush runtime journal.778gitlab # [ 5.816983] systemd[1]: Starting Firewall...779gitlab # [ 5.818156] systemd[1]: Starting Apply Kernel Variables...780gitlab # [ 5.819216] systemd[1]: Finished Load/Save OS Random Seed.781gitlab # [ 5.820559] systemd[1]: Reached target First Boot Complete.782gitlab # [ 5.821570] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.783gitlab # [ 5.823343] systemd[1]: Starting Create Static Device Nodes in /dev...784gitlab # [ 5.824306] systemd[1]: Finished Apply Kernel Variables.785gitlab # [ 5.825133] systemd[1]: Finished Create Static Device Nodes in /dev.786gitlab # [ 5.826089] systemd[1]: Reached target Preparation for Local File Systems.787gitlab # [ 5.827079] systemd[1]: Starting Rule-based Manager for Device Events and Files...788gitlab # [ 5.828092] systemd[1]: Finished Flush Journal to Persistent Storage.789gitlab # [ 5.831250] systemd-udevd[353]: Using default interface naming scheme 'v261'.790gitlab # [ 5.859418] systemd[1]: Finished Coldplug All udev Devices.791gitlab # [ 5.862971] systemd[1]: Started Rule-based Manager for Device Events and Files.792gitlab # [ 5.938751] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 5.953916] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 5.971830] (udev-worker)[425]: Network interface NamePolicy= disabled on kernel command line.795gitlab # [ 5.975187] (udev-worker)[417]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.796gitlab # [ 5.977424] (udev-worker)[417]: Network interface NamePolicy= disabled on kernel command line.797gitlab # [ 5.988682] systemd[1]: Condition check resulted in Virtio network device being skipped.798gitlab # [ 5.990044] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore799gitlab # [ 5.991706] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67800gitlab # [ 5.994125] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore801gitlab # [ 5.995738] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os802gitlab # [ 5.997045] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os803gitlab # [ 6.013853] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.804gitlab # [ 6.186178] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0805gitlab # [ 6.187319] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD806gitlab # [ 6.188431] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3807gitlab # [ 6.199552] rtc_cmos 00:05: RTC can wake from S4808gitlab # [ 6.203135] ACPI: button: Power Button [PWRF]809gitlab # [ 6.210273] rtc_cmos 00:05: registered as rtc0810gitlab # [ 6.213395] rtc_cmos 00:05: setting system clock to 2026-09-13T10:45:12 UTC (1789296312)811gitlab # [ 6.213422] systemd-journald[319]: Time jumped backwards, rotating.812gitlab # [ 6.215974] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs813gitlab # [ 6.219432] Floppy drive(s): fd0 is 2.88M AMI BIOS814gitlab # [ 6.231438] FDC 0 is a S82078B815gitlab # [ 6.240174] parport_pc 00:03: reported by Plug and Play ACPI816gitlab # [ 6.241189] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console817gitlab # [ 6.245038] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]818gitlab # [ 6.248445] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5819gitlab # [ 6.257103] Console: switching to colour dummy device 80x25820gitlab # [ 6.258003] mousedev: PS/2 mouse device common for all mice821gitlab # [ 6.260683] [drm] Found bochs VGA, ID 0xb0c5.822gitlab # [ 6.260971] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4823gitlab # [ 6.261210] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.824gitlab # [ 6.264571] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic825gitlab # [ 6.265910] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0826gitlab # [ 6.128409] systemd[1]: Finished Firewall.827gitlab # [ 6.285474] Console: switching to colour frame buffer device 160x50828gitlab # [ 6.287129] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device829gitlab # [ 6.287658] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6830gitlab # [ 6.181080] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.341957] ppdev: user-space parallel port driver832gitlab # [ 6.196880] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.833gitlab # [ 6.198578] systemd[1]: Stopped Virtual Console Setup.834gitlab # [ 6.204294] systemd[1]: Starting Virtual Console Setup...835gitlab # [ 6.214151] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.836gitlab # [ 6.217163] systemd[1]: Stopped Virtual Console Setup.837gitlab # [ 6.221421] systemd[1]: Starting Virtual Console Setup...838gitlab # [ 6.281714] systemd-vconsole-setup[494]: Configuration of first virtual console was skipped, ignoring remaining ones.839gitlab # [ 6.284739] systemd[1]: Finished Virtual Console Setup.840gitlab # [ 6.446300] kvm_amd: TSC scaling supported841gitlab # [ 6.446775] kvm_amd: Nested Virtualization enabled842gitlab # [ 6.447361] kvm_amd: Nested Paging enabled843gitlab # [ 6.447800] kvm_amd: LBR virtualization supported844gitlab # [ 6.448347] kvm_amd: Virtual VMLOAD VMSAVE supported845gitlab # [ 6.448857] kvm_amd: Virtual GIF supported846gitlab # [ 6.449344] kvm_amd: Virtual NMI enabled847gitlab # [ 6.481611] EDAC MC: Ver: 3.0.0848gitlab # [ 6.585719] systemd[1]: Mounting /run/wrappers...849gitlab # [ 6.610743] systemd[1]: Mounted /run/wrappers.850gitlab # [ 6.612544] systemd[1]: Reached target Local File Systems.851gitlab # [ 6.614572] systemd[1]: Listening on Boot Loader Control Service Socket.852gitlab # [ 6.616939] systemd[1]: Starting register-nix-paths.service...853gitlab # [ 6.619232] systemd[1]: Starting Create SUID/SGID Wrappers...854gitlab # [ 6.621329] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.855gitlab # [ 6.624425] systemd[1]: Starting Save Transient machine-id to Disk...856gitlab # [ 6.627081] systemd[1]: Starting Create System Files and Directories...857gitlab # [ 6.643217] systemd[1]: Finished Create System Files and Directories.858gitlab # [ 6.647167] systemd[1]: Starting Rebuild Journal Catalog...859gitlab # [ 6.650294] systemd[1]: Starting Record System Boot/Shutdown in UTMP...860gitlab # [ 6.665584] systemd[1]: Finished Record System Boot/Shutdown in UTMP.861gitlab # [ 6.671218] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.862gitlab # [ 6.673285] systemd[1]: Finished Save Transient machine-id to Disk.863gitlab # [ 6.694747] systemd[1]: Finished Rebuild Journal Catalog.864gitlab # [ 6.697724] systemd[1]: Starting Update is Completed...865gitlab # [ 6.713073] systemd[1]: Finished Update is Completed.866gitlab # [ 6.769878] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.867gitlab # [ 6.771577] systemd[1]: Finished Create SUID/SGID Wrappers.868gitlab # [ 6.948509] systemd[1]: Finished register-nix-paths.service.869gitlab # [ 6.950140] systemd[1]: Reached target System Initialization.870gitlab # [ 6.951453] systemd[1]: Started Discard unused filesystem blocks once a week.871gitlab # [ 6.952675] systemd[1]: Started logrotate.timer.872gitlab # [ 6.953380] systemd[1]: Started Daily Cleanup of Temporary Directories.873gitlab # [ 6.954335] systemd[1]: Reached target Timer Units.874gitlab # [ 6.955154] systemd[1]: Listening on D-Bus System Message Bus Socket.875gitlab # [ 6.956090] systemd[1]: Listening on Nix Daemon Socket.876gitlab # [ 6.958293] systemd[1]: Starting nixbot CI service socket...877gitlab # [ 6.959139] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.878gitlab # [ 6.961606] systemd[1]: Listening on nixbot CI service socket.879gitlab # [ 6.962491] systemd[1]: Reached target Socket Units.880gitlab # [ 6.965560] systemd[1]: Starting D-Bus System Message Bus...881gitlab # [ 6.997847] dbus-broker-launch[576]: Looking up NSS user entry for 'systemd-timesync'...882gitlab # [ 6.999920] dbus-broker-launch[576]: NSS returned no entry for 'systemd-timesync'883gitlab # [ 7.002333] dbus-broker-launch[576]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"884gitlab # [ 7.006588] systemd[1]: Started D-Bus System Message Bus.885gitlab # [ 7.017821] dbus-broker-launch[576]: Ready886gitlab # [ 7.019182] systemd[1]: Reached target Basic System.887gitlab # [ 7.020471] systemd[1]: Started backdoor.service.888gitlab # [ 7.021749] systemd[1]: Starting gitlab-config.service...889gitlab # [ 7.026143] systemd[1]: Starting Import lastlog data into lastlog2 database...890gitlab # [ 7.027653] systemd[1]: Starting Logrotate configuration check...891gitlab # [ 7.029127] systemd[1]: Starting Name Service Cache Daemon (nsncd)...892gitlab # [ 7.041236] systemd[1]: Starting Post-Boot Actions...893gitlab # [ 7.044781] logrotate[581]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.894gitlab # [ 7.047296] logrotate[581]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf895gitlab # [ 7.048709] logrotate[581]: note: 'monthly' overrides previously specified 'weekly'896gitlab # [ 7.049875] logrotate[581]: Reading state from file: /var/lib/logrotate.status897gitlab # [ 7.050900] logrotate[581]: state file /var/lib/logrotate.status does not exist898gitlab # [ 7.052924] logrotate[581]: Allocating hash table for state file, size 64 entries899gitlab # [ 7.053999] logrotate[581]: Handling 4 logs900gitlab # [ 7.054593] logrotate[581]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed901gitlab # [ 7.059098] logrotate[581]: considering log /var/log/btmp902gitlab # [ 7.059873] logrotate[581]: Creating new state903gitlab # [ 7.060480] logrotate[581]: Now: 2026-09-13 10:45904gitlab # [ 7.061992] logrotate[581]: Last rotated at 2026-09-13 10:00905gitlab # [ 7.063120] logrotate[581]: log does not need rotating (log has already been rotated)906gitlab # connecting to host...907gitlab # [ 7.063771] logrotate[581]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed908gitlab # [ 7.065174] logrotate[581]: considering log /var/log/wtmp909gitlab # [ 7.065782] logrotate[581]: Creating new state910gitlab # [ 7.066409] logrotate[581]: Now: 2026-09-13 10:45911gitlab # [ 7.066934] logrotate[581]: Last rotated at 2026-09-13 10:00912gitlab # [ 7.067614] logrotate[581]: log does not need rotating (log has already been rotated)913gitlab # [ 7.068136] logrotate[581]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed914gitlab # [ 7.068600] logrotate[581]: switching euid from 0 to 165 and egid from 0 to 165 (pid 581)915gitlab # [ 7.069067] logrotate[581]: considering log /var/gitlab/state/log/*.log916gitlab # [ 7.069507] logrotate[581]: log /var/gitlab/state/log/*.log does not exist -- skipping917gitlab # [ 7.070030] logrotate[581]: Creating new state918gitlab # [ 7.070464] logrotate[581]: switching euid from 165 to 0 and egid from 165 to 0 (pid 581)919gitlab # [ 7.071030] logrotate[581]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed920gitlab # [ 7.071469] logrotate[581]: switching euid from 0 to 60 and egid from 0 to 60 (pid 581)921gitlab # [ 7.071992] logrotate[581]: considering log /var/log/nginx/*.log922gitlab # [ 7.072492] logrotate[581]: log /var/log/nginx/*.log does not exist -- skipping923gitlab # [ 7.072983] logrotate[581]: Creating new state924gitlab # [ 7.073647] logrotate[581]: not running postrotate script, since no logs were rotated925gitlab # [ 7.074146] logrotate[581]: switching euid from 60 to 0 and egid from 60 to 0 (pid 581)926gitlab # [ 7.074821] systemd[1]: Started Reset console on configuration changes.927gitlab # [ 7.075675] systemd[1]: Starting resolvconf update...928gitlab # [ 7.076221] systemd[1]: Finished Logrotate configuration check.929gitlab: Guest shell says: b'Spawning backdoor root shell...\n'930gitlab: connected to guest root shell931gitlab # [ 7.091799] systemd[1]: Finished Post-Boot Actions.932gitlab: (connecting took 7.68 seconds)933gitlab: (finished: waiting for the VM to finish booting, in 7.68 seconds)934gitlab # [ 7.097805] systemd[1]: Finished Import lastlog data into lastlog2 database.935gitlab # [ 7.103931] nsncd[582]: Sep 13 10:45:13.535 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"936gitlab # [ 7.104940] systemd[1]: Started Name Service Cache Daemon (nsncd).937gitlab # [ 7.105586] systemd[1]: Reached target Host and Network Name Lookups.938gitlab # [ 7.106058] systemd[1]: Reached target User and Group Name Lookups.939gitlab # [ 7.107227] systemd[1]: Starting User Login Management...940gitlab # [ 7.146406] systemd-logind[617]: New seat seat0.941gitlab # [ 7.148599] systemd-logind[617]: Watching system buttons on /dev/input/event2 (Power Button)942gitlab # [ 7.149513] systemd-logind[617]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)943gitlab # [ 7.151275] systemd-logind[617]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)944gitlab # [ 7.151914] systemd[1]: Started User Login Management.945gitlab # [ 7.152413] systemd[1]: Starting linger-users.service...946gitlab # [ 7.156178] systemd[1]: Stopped target Host and Network Name Lookups.947gitlab # [ 7.158099] systemd[1]: Stopping Host and Network Name Lookups...948gitlab # [ 7.158856] systemd[1]: Stopped target User and Group Name Lookups.949gitlab # [ 7.159513] systemd[1]: Stopping User and Group Name Lookups...950gitlab # [ 7.160107] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...951gitlab # [ 7.163185] systemd[1]: nscd.service: Deactivated successfully.952gitlab # [ 7.165098] systemd[1]: Stopped Name Service Cache Daemon (nsncd).953gitlab # [ 7.165798] systemd[1]: nscd.service: Consumed 21ms CPU time over 134ms wall clock time, 7.5M memory peak, 5.5M read from disk.954gitlab # [ 7.168962] systemd[1]: Starting Name Service Cache Daemon (nsncd)...955gitlab # [ 7.172219] systemd[1]: linger-users.service: Deactivated successfully.956gitlab # [ 7.172823] systemd[1]: Finished linger-users.service.957gitlab # [ 7.184254] nsncd[674]: Sep 13 10:45:13.616 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"958gitlab # [ 7.184962] systemd[1]: Started Name Service Cache Daemon (nsncd).959gitlab # [ 7.185519] systemd[1]: Reached target Host and Network Name Lookups.960gitlab # [ 7.186082] systemd[1]: Reached target User and Group Name Lookups.961gitlab # [ 7.193638] systemd[1]: Finished resolvconf update.962gitlab # [ 7.195360] systemd[1]: Reached target Preparation for Network.963gitlab # [ 7.197061] systemd[1]: Starting DHCP Client...964gitlab # [ 7.199038] systemd[1]: Starting Address configuration of eth1...965gitlab # [ 7.202706] systemd[1]: Starting Extra networking commands....966gitlab # [ 7.242602] network-addresses-eth1-start[699]: adding address 192.168.1.1/24... done967gitlab # [ 7.246684] network-addresses-eth1-start[699]: adding address 2001:db8:1::1/64... done968gitlab # [ 7.252326] systemd[1]: Finished Address configuration of eth1.969gitlab # [ 7.269053] dhcpcd[707]: dhcpcd-10.3.2 starting970gitlab # [ 7.271080] dhcpcd[758]: dev: loaded udev971gitlab # [ 7.276083] systemd[1]: Finished Extra networking commands..972gitlab # [ 7.423150] 8021q: 802.1Q VLAN Support v1.8973gitlab # [ 7.277482] s[ 7.423651] 8021q: adding VLAN 0 to HW filter on device eth1974gitlab # ystemd[1]: Reached target Network.975gitlab # [ 7.281362] systemd[1]: Starting gitlab-workhorse.service...976gitlab # [ 7.284832] systemd[1]: Starting Nginx Web Server...977gitlab # [ 7.286149] systemd[1]: Starting PostgreSQL Server...978gitlab # [ 7.289952] systemd[1]: Starting Redis Server - redis-gitlab...979gitlab # [ 7.293173] systemd[1]: Starting Permit User Sessions...980gitlab # [ 7.301971] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.981gitlab # [ 7.321080] systemd[1]: Finished Permit User Sessions.982gitlab # [ 7.323709] systemd[1]: Started Getty on tty1.983gitlab # [ 7.326356] systemd[1]: Reached target Login Prompts.984gitlab # [ 7.522456] cfg80211: Loading compiled-in X.509 certificates for regulatory database985gitlab # [ 7.528654] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'986gitlab # [ 7.529642] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'987gitlab # [ 7.531223] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2988gitlab # [ 7.532292] cfg80211: failed to load regulatory.db989gitlab # [ 7.406822] nginx-pre-start[785]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok990gitlab # [ 7.407850] nginx-pre-start[785]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful991gitlab # [ 7.412389] systemd[1]: Started Nginx Web Server.992gitlab # [ 7.560483] 8021q: adding VLAN 0 to HW filter on device eth0993gitlab # [ 7.419877] dhcpcd[758]: eth0: waiting for carrier994gitlab # [ 7.422543] dhcpcd[758]: eth0: carrier acquired995gitlab # [ 7.426073] dhcpcd[758]: DUID 00:01:00:01:32:39:3b:39:52:54:00:12:34:56996gitlab # [ 7.427654] dhcpcd[758]: eth0: IAID 00:12:34:56997gitlab # [ 7.428431] dhcpcd[758]: eth0: adding address fe80::5054:ff:fe12:3456998gitlab # [ 7.443302] redis-server[788]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.999gitlab # [ 7.445050] redis-server[788]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1000gitlab # [ 7.445928] redis-server[788]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=788, just started1001gitlab # [ 7.446536] redis-server[788]: Configuration loaded1002gitlab # [ 7.449170] redis[788]: monotonic clock: POSIX clock_gettime1003gitlab # [ 7.449812] redis[788]: Running mode=standalone, port=0.1004gitlab # [ 7.450416] redis[788]: Server initialized1005gitlab # [ 7.450885] redis[788]: Ready to accept connections unix1006gitlab # [ 7.451465] redis[788]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1007gitlab # [ 7.453187] systemd[1]: Started Redis Server - redis-gitlab.1008gitlab # [ 7.455756] postgresql-pre-start[795]: The files belonging to this database system will be owned by user "postgres".1009gitlab # [ 7.456531] postgresql-pre-start[795]: This user must also own the server process.1010gitlab # [ 7.460556] postgresql-pre-start[795]: The database cluster will be initialized with locale "en_US.UTF-8".1011gitlab # [ 7.461756] postgresql-pre-start[795]: The default database encoding has accordingly been set to "UTF8".1012gitlab # [ 7.462569] postgresql-pre-start[795]: The default text search configuration will be set to "english".1013gitlab # [ 7.463708] postgresql-pre-start[795]: Data page checksums are enabled.1014gitlab # [ 7.464706] postgresql-pre-start[795]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1015gitlab # [ 7.465398] postgresql-pre-start[795]: creating subdirectories ... ok1016gitlab # [ 7.466483] postgresql-pre-start[795]: selecting dynamic shared memory implementation ... posix1017gitlab # [ 7.497988] postgresql-pre-start[795]: selecting default "max_connections" ... 1001018gitlab # [ 7.543209] postgresql-pre-start[795]: selecting default "shared_buffers" ... 128MB1019gitlab # [ 7.768905] systemd[1]: Started gitlab-workhorse.service.1020gitlab # [ 7.926850] postgresql-pre-start[795]: selecting default time zone ... UTC1021gitlab # [ 7.928897] postgresql-pre-start[795]: creating configuration files ... ok1022gitlab # [ 7.963205] gitlab-workhorse[823]: time="2026-09-13T10:45:14Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41023gitlab # [ 7.963953] gitlab-workhorse[823]: time="2026-09-13T10:45:14Z" level=info msg="Using redis/go-redis"1024gitlab # [ 7.964670] gitlab-workhorse[823]: time="2026-09-13T10:45:14Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1025gitlab # [ 8.014170] dhcpcd[758]: eth0: soliciting a DHCP lease1026gitlab # [ 8.165786] NET: Registered PF_PACKET protocol family1027gitlab # [ 8.039517] dhcpcd[758]: eth0: offered 10.0.2.15 from 10.0.2.21028gitlab # [ 8.048481] dhcpcd[758]: eth0: probing address 10.0.2.15/241029gitlab # [ 8.105135] postgresql-pre-start[795]: running bootstrap script ... ok1030gitlab # [ 8.524701] postgresql-pre-start[795]: performing post-bootstrap initialization ... ok1031gitlab # [ 8.735354] postgresql-pre-start[795]: syncing data to disk ... ok1032gitlab # [ 8.736141] postgresql-pre-start[795]: initdb: warning: enabling "trust" authentication for local connections1033gitlab # [ 8.736523] postgresql-pre-start[795]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1034gitlab # [ 8.737110] postgresql-pre-start[795]: Success. You can now start the database server using:1035gitlab # [ 8.737575] postgresql-pre-start[795]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1036gitlab # [ 8.842466] postgres[850]: [850] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1037gitlab # [ 8.846383] postgres[850]: [850] LOG: listening on IPv6 address "::1", port 54321038gitlab # [ 8.849333] postgres[850]: [850] LOG: listening on IPv4 address "127.0.0.1", port 54321039gitlab # [ 8.852240] postgres[850]: [850] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1040gitlab # [ 8.859151] postgres[863]: [863] LOG: database system was shut down at 2026-09-13 10:45:14 GMT1041gitlab # [ 8.867211] postgres[850]: [850] LOG: database system is ready to accept connections1042gitlab # [ 8.870375] systemd[1]: Started PostgreSQL Server.1043gitlab # [ 8.874881] systemd[1]: Starting PostgreSQL Setup Scripts...1044gitlab # [ 8.964066] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[857]: mkdir -p /var/gitlab/state/home/.ssh: OK1045gitlab # [ 8.967103] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[857]: chmod 700 /var/gitlab/state/home/.ssh: OK1046gitlab # [ 9.030399] systemd[1]: Finished gitlab-config.service.1047gitlab # [ 9.032568] systemd[1]: Started gitaly.service.1048gitlab # [ 9.061289] postgresql-setup-start[875]: CREATE DATABASE1049gitlab # [ 9.095495] postgresql-setup-start[894]: CREATE ROLE1050gitlab # [ 9.107618] postgresql-setup-start[896]: ALTER DATABASE1051gitlab # [ 9.129451] postgresql-setup-start[901]: CREATE ROLE1052gitlab # [ 9.132460] systemd[1]: Finished PostgreSQL Setup Scripts.1053gitlab # [ 9.135434] systemd[1]: Reached target PostgreSQL.1054gitlab # [ 9.138834] systemd[1]: Starting gitlab-db-config.service...1055gitlab # [ 9.142368] systemd[1]: Starting gitlab-postgresql.service...1056gitlab # [ 9.234060] gitlab-postgresql-start[915]: CREATE DATABASE1057gitlab # [ 9.265423] gitlab-postgresql-start[931]: CREATE EXTENSION1058gitlab # [ 9.343180] gitlab-postgresql-start[933]: CREATE EXTENSION1059gitlab # [ 9.346880] systemd[1]: Finished gitlab-postgresql.service.1060gitlab # [ 9.555692] dhcpcd[758]: eth0: soliciting an IPv6 router1061gitlab # [ 9.556770] gitaly[889]: time="2026-09-13T10:45:15.988Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=8891062gitlab # [ 9.560180] gitaly[889]: time="2026-09-13T10:45:15.988Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=8891063gitlab # [ 9.561913] gitaly[889]: time="2026-09-13T10:45:15.988Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=8891064gitlab # [ 9.563850] gitaly[889]: time="2026-09-13T10:45:15.988Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=8891065gitlab # [ 9.565594] gitaly[889]: time="2026-09-13T10:45:15.988Z" level=info msg="Starting Gitaly" pid=889 version=1066gitlab # [ 9.567423] dhcpcd[758]: eth0: Router Advertisement from fe80::21067gitlab # [ 9.568520] dhcpcd[758]: eth0: adding address fec0::5054:ff:fe12:3456/641068gitlab # [ 9.569428] dhcpcd[758]: eth0: adding route to fec0::/641069gitlab # [ 9.570305] dhcpcd[758]: eth0: adding default route via fe80::21070gitlab # [ 9.722503] gitaly[889]: time="2026-09-13T10:45:16.154Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=165 pid=8891071gitlab # [ 9.724251] gitaly[889]: time="2026-09-13T10:45:16.154Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=8891072gitlab # [ 9.726027] gitaly[889]: time="2026-09-13T10:45:16.155Z" level=info msg="finished initializing command factory" duration_ms=0 pid=8891073gitlab # [ 9.727888] gitaly[889]: time="2026-09-13T10:45:16.155Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-889/git-exec-874014329.d/git pid=8891074gitlab # [ 9.730118] gitaly[889]: time="2026-09-13T10:45:16.159Z" level=info msg="finished detecting git version" duration_ms=4 pid=8891075gitlab # [ 9.731834] gitaly[889]: time="2026-09-13T10:45:16.159Z" level=info msg="using Git version" pid=889 version=2.53.g1076gitlab # [ 9.733567] gitaly[889]: time="2026-09-13T10:45:16.160Z" level=info msg="clearing disk cache object folder" pid=889 storage=default1077gitlab # [ 9.735310] gitaly[889]: time="2026-09-13T10:45:16.160Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1153729044 pid=889 storage=default1078gitlab # [ 9.737783] gitaly[889]: time="2026-09-13T10:45:16.160Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1153729044 pid=889 storage=default1079gitlab # [ 9.740833] gitaly[889]: time="2026-09-13T10:45:16.160Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=8891080gitlab # [ 9.743739] gitaly[889]: time="2026-09-13T10:45:16.160Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=8891081gitlab # [ 9.746465] gitaly[889]: time="2026-09-13T10:45:16.160Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1153729044 clear_duration_ms=0 pid=889 storage=default1082gitlab # [ 9.763854] gitaly[889]: time="2026-09-13T10:45:16.196Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8891083gitlab # [ 9.766344] gitaly[889]: time="2026-09-13T10:45:16.196Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=889 schema=unix1084gitlab # [ 9.768820] gitaly[889]: time="2026-09-13T10:45:16.196Z" level=info msg="counting repositories" pid=8891085gitlab # [ 9.769410] gitaly[889]: time="2026-09-13T10:45:16.196Z" level=info msg="starting to count repositories" pid=889 storage_path=/var/gitlab/state/repositories1086gitlab # [ 9.769923] gitaly[889]: time="2026-09-13T10:45:16.196Z" level=info msg="finished tempdir cleaner walk" pid=889 storage=default time_ms=01087gitlab # [ 9.770632] gitaly[889]: time="2026-09-13T10:45:16.196Z" level=info msg="listening at address" address=/run/gitaly/gitaly-889/sock.d/intern pid=889 schema=unix1088gitlab # [ 9.771209] gitaly[889]: time="2026-09-13T10:45:16.197Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=889 storage_path=/var/gitlab/state/repositories1089gitlab # [ 9.771791] gitaly[889]: time="2026-09-13T10:45:16.197Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8891090gitlab # [ 9.772565] gitaly[889]: time="2026-09-13T10:45:16.197Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8891091gitlab # [ 9.773161] gitaly[889]: time="2026-09-13T10:45:16.197Z" level=info msg="Started Gitaly" duration_ms=209 pid=8891092gitlab # [ 9.773796] gitaly[889]: time="2026-09-13T10:45:16.197Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8891093gitlab # [ 9.774140] gitaly[889]: time="2026-09-13T10:45:16.198Z" level=info msg="maintenance: daily scheduled" pid=889 scheduled="2026-09-13 12:00:00 +0000 UTC"1094gitlab # [ 10.430927] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[906]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1095gitlab # [ 10.431784] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[906]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1096gitlab # [ 10.459479] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[906]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1097gitlab # [ 11.616054] gitaly[889]: time="2026-09-13T10:45:18.047Z" level=info msg="License database preloaded" duration_ms=2059 pid=8891098gitlab # [ 12.765875] dhcpcd[758]: eth0: leased 10.0.2.15 for 86400 seconds1099gitlab # [ 12.766660] dhcpcd[758]: eth0: adding route to 10.0.2.0/241100gitlab # [ 12.767366] dhcpcd[758]: eth0: adding default route via 10.0.2.21101gitlab # [ 12.872053] systemd[1]: Started DHCP Client.1102gitlab # [ 12.874326] systemd[1]: Reached target Network is Online.1103gitlab # [ 39.558086] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[906]: W, [2026-09-13T10:45:45.989653 #906] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1104gitlab # [ 41.677932] postgres[1299]: [1299] ERROR: relation "feature_gates" does not exist at character 5231105gitlab # [ 41.679123] postgres[1299]: [1299] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1106gitlab # [ 41.679763] postgres[1299]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1107gitlab # [ 41.680886] postgres[1299]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1108gitlab # [ 41.681816] postgres[1299]: attidentity AS identity,1109gitlab # [ 41.682772] postgres[1299]: attgenerated as attgenerated1110gitlab # [ 41.683831] postgres[1299]: FROM pg_attribute a1111gitlab # [ 41.685327] postgres[1299]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1112gitlab # [ 41.686814] postgres[1299]: LEFT JOIN pg_type t ON a.atttypid = t.oid1113gitlab # [ 41.688461] postgres[1299]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1114gitlab # [ 41.689974] postgres[1299]: WHERE a.attrelid = '"feature_gates"'::regclass1115gitlab # [ 41.690823] postgres[1299]: AND a.attnum > 0 AND NOT a.attisdropped1116gitlab # [ 41.692608] postgres[1299]: ORDER BY a.attnum1117gitlab # [ 41.693887] postgres[1299]:1118gitlab # [ 44.900435] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1332]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1119gitlab # [ 44.901808] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1332]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1120gitlab # [ 48.027584] gitlab-workhorse[823]: time="2026-09-13T10:45:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 58.038782] gitlab-workhorse[823]: time="2026-09-13T10:46:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 59.565432] postgres[1407]: [1407] ERROR: relation "table_without_models" does not exist1123gitlab # [ 59.568254] postgres[1407]: [1407] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1124gitlab # [ 68.048509] gitlab-workhorse[823]: time="2026-09-13T10:46:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1125gitlab # [ 71.296792] systemd[1]: Finished gitlab-db-config.service.1126gitlab # [ 71.300753] systemd[1]: Started gitlab-sidekiq.service.1127gitlab # [ 71.304529] systemd[1]: Starting gitlab.service...1128gitlab # [ 71.660896] bundle[1574]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1129gitlab # [ 71.662180] bundle[1574]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1130gitlab # [ 71.662996] bundle[1574]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1131gitlab # [ 74.305490] sidekiq-cluster[1573]: {"severity":"INFO","time":"2026-09-13T10:46:20.721Z","message":"Starting cluster with 1 processes"}1132gitlab # [ 74.457135] bundle[1574]: {"timestamp":"2026-09-13T10:46:20.868Z","pid":1574,"message":"* Enabling systemd notification integration"}1133gitlab # [ 74.461214] bundle[1574]: {"timestamp":"2026-09-13T10:46:20.888Z","pid":1574,"message":"Puma starting in cluster mode..."}1134gitlab # [ 74.464503] bundle[1574]: {"timestamp":"2026-09-13T10:46:20.888Z","pid":1574,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1135gitlab # [ 74.468136] bundle[1574]: {"timestamp":"2026-09-13T10:46:20.888Z","pid":1574,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1136gitlab # [ 74.472374] bundle[1574]: {"timestamp":"2026-09-13T10:46:20.888Z","pid":1574,"message":"* Min threads: 0"}1137gitlab # [ 74.475399] bundle[1574]: {"timestamp":"2026-09-13T10:46:20.888Z","pid":1574,"message":"* Max threads: 4"}1138gitlab # [ 74.478330] bundle[1574]: {"timestamp":"2026-09-13T10:46:20.888Z","pid":1574,"message":"* Environment: production"}1139gitlab # [ 74.481438] bundle[1574]: {"timestamp":"2026-09-13T10:46:20.888Z","pid":1574,"message":"* Master PID: 1574"}1140gitlab # [ 74.484452] bundle[1574]: {"timestamp":"2026-09-13T10:46:20.888Z","pid":1574,"message":"* Workers: 2"}1141gitlab # [ 74.487359] bundle[1574]: {"timestamp":"2026-09-13T10:46:20.889Z","pid":1574,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1142gitlab # [ 74.491116] bundle[1574]: {"timestamp":"2026-09-13T10:46:20.889Z","pid":1574,"message":"* Preloading application"}1143gitlab # [ 78.058923] gitlab-workhorse[823]: time="2026-09-13T10:46:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 88.067910] gitlab-workhorse[823]: time="2026-09-13T10:46:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 96.454696] bundle[1574]: W, [2026-09-13T10:46:42.886248 #1574] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 98.069188] gitlab-workhorse[823]: time="2026-09-13T10:46:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1147gitlab # [ 98.949074] sidekiq-cluster[1600]: 2026-09-13T10:46:45.381Z pid=1600 tid=wko INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1600, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>452710400}1148gitlab # [ 99.118450] sidekiq-cluster[1600]: W, [2026-09-13T10:46:45.550651 #1600] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1149gitlab # [ 99.156722] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:45.588Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1150gitlab # [ 101.079233] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.510Z","message":"GitLab reliable fetch activated!"}1151gitlab # [ 101.080330] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.510Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1152gitlab # [ 101.100953] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.533Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1153gitlab # [ 101.103147] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.535Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1154gitlab # [ 101.105526] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.537Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1155gitlab # [ 101.107776] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.540Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1156gitlab # [ 101.110103] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.542Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1157gitlab # [ 101.112356] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.544Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1158gitlab # [ 101.114537] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.546Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1159gitlab # [ 101.116402] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.548Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1160gitlab # [ 101.118287] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.550Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1161gitlab # [ 101.120124] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.552Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1162gitlab # [ 101.121884] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.554Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1163gitlab # [ 101.124198] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.556Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1164gitlab # [ 101.125959] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.558Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1165gitlab # [ 101.127849] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.560Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1166gitlab # [ 101.129904] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.562Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1167gitlab # [ 101.131922] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.564Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1168gitlab # [ 101.134324] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.566Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1169gitlab # [ 101.136623] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.569Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1170gitlab # [ 101.138908] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.571Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1171gitlab # [ 101.141095] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.573Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1172gitlab # [ 101.143346] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.575Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1173gitlab # [ 101.145473] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.577Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1174gitlab # [ 101.147588] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.579Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1175gitlab # [ 101.149474] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.581Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1176gitlab # [ 101.151420] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.583Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1177gitlab # [ 101.153700] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.586Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1178gitlab # [ 101.155841] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.588Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1179gitlab # [ 101.159699] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.591Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1180gitlab # [ 101.164543] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.596Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1181gitlab # [ 101.169037] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.601Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1182gitlab # [ 101.172592] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.605Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1183gitlab # [ 101.177036] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.609Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1184gitlab # [ 101.180601] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.613Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1185gitlab # [ 101.184237] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.616Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1186gitlab # [ 101.187393] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.619Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1187gitlab # [ 101.189522] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.621Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1188gitlab # [ 101.191624] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.623Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1189gitlab # [ 101.193970] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.626Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1190gitlab # [ 101.196895] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.629Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1191gitlab # [ 101.199865] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.632Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1192gitlab # [ 101.202897] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.635Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1193gitlab # [ 101.207186] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.639Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1194gitlab # [ 101.211565] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.644Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1195gitlab # [ 101.216699] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.649Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1196gitlab # [ 101.221115] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.653Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1197gitlab # [ 101.225717] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.658Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1198gitlab # [ 101.230969] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.663Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1199gitlab # [ 101.236290] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.668Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1200gitlab # [ 101.241777] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.674Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1201gitlab # [ 101.246776] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.679Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1202gitlab # [ 101.252101] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.684Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1203gitlab # [ 101.257810] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.690Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1204gitlab # [ 101.288417] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.720Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1205gitlab # [ 101.292359] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.724Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1206gitlab # [ 101.297085] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.729Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1207gitlab # [ 101.300956] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.733Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1208gitlab # [ 101.305093] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.737Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1209gitlab # [ 101.309684] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.742Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1210gitlab # [ 101.313377] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.745Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1211gitlab # [ 101.317314] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.749Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1212gitlab # [ 101.321705] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.754Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1213gitlab # [ 101.326262] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.758Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1214gitlab # [ 101.331519] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.763Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1215gitlab # [ 101.337102] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.769Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1216gitlab # [ 101.341490] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.773Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1217gitlab # [ 101.346266] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.778Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1218gitlab # [ 101.349807] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.782Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1219gitlab # [ 101.353736] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.786Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1220gitlab # [ 101.358095] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.790Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1221gitlab # [ 101.363142] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.795Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1222gitlab # [ 101.367428] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.799Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1223gitlab # [ 101.371547] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.803Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1224gitlab # [ 101.376107] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.808Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1225gitlab # [ 101.380404] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.812Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1226gitlab # [ 101.385125] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.817Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1227gitlab # [ 101.389511] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.821Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1228gitlab # [ 101.394394] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.826Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1229gitlab # [ 101.399261] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.831Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1230gitlab # [ 101.403561] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.836Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1231gitlab # [ 101.408334] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.840Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1232gitlab # [ 101.412780] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.845Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1233gitlab # [ 101.417634] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.850Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1234gitlab # [ 101.422794] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.855Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1235gitlab # [ 101.427803] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.860Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1236gitlab # [ 101.432413] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.864Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1237gitlab # [ 101.436704] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.869Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1238gitlab # [ 101.441782] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.874Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1239gitlab # [ 101.445897] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.878Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1240gitlab # [ 101.450454] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.882Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1241gitlab # [ 101.454543] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.886Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1242gitlab # [ 101.458759] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.891Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1243gitlab # [ 101.462669] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.895Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1244gitlab # [ 101.467114] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.899Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1245gitlab # [ 101.471573] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.903Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1246gitlab # [ 101.476301] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.908Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1247gitlab # [ 101.481543] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.913Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1248gitlab # [ 101.485875] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.918Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1249gitlab # [ 101.489836] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.922Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1250gitlab # [ 101.498596] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.930Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1251gitlab # [ 101.503309] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.935Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1252gitlab # [ 101.507540] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.939Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1253gitlab # [ 101.512755] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.945Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1254gitlab # [ 101.517211] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.949Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1255gitlab # [ 101.521579] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.954Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1256gitlab # [ 101.526277] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.958Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1257gitlab # [ 101.530461] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.962Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1258gitlab # [ 101.534212] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.966Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1259gitlab # [ 101.539575] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.971Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1260gitlab # [ 101.543707] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:46:47.976Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1261gitlab # [ 108.079167] gitlab-workhorse[823]: time="2026-09-13T10:46:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1262gitlab # [ 118.088843] gitlab-workhorse[823]: time="2026-09-13T10:47:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1263gitlab # [ 124.723222] postgres[2024]: [2024] ERROR: relation "table_without_models" does not exist1264gitlab # [ 124.726101] postgres[2024]: [2024] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1265gitlab # [ 126.404994] postgres[2044]: [2044] ERROR: relation "table_without_models" does not exist1266gitlab # [ 126.406371] postgres[2044]: [2044] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1267gitlab # [ 127.281628] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:13.713Z","message":"Booted Rails 7.2.3.1 application in production environment"}1268gitlab # [ 127.285998] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:13.713Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1269gitlab # [ 127.290519] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:13.713Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1270gitlab # [ 127.294571] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:13.713Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1271gitlab # [ 127.299217] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:13.715Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1272gitlab # [ 128.090491] gitlab-workhorse[823]: time="2026-09-13T10:47:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1273gitlab # [ 128.522526] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:14.954Z","message":"Cleaning working queues"}1274gitlab # [ 128.526176] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:14.955Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7a1814914735b080f9f8c903","created_at":"2026-09-13T10:46:17.400Z","trace_propagation_headers":{"sentry-trace":"a26fe266460f44eb923223c4c5c69504-307d9346073a4e8f","baggage":"sentry-trace_id=a26fe266460f44eb923223c4c5c69504,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"cca6a1fa78206105845ec814136be02b","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-13T10:46:17.407Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7a1814914735b080f9f8c903: start","job_status":"start","queue_duration_s":57.547664,"scheduling_latency_s":57.547724}1275gitlab # [ 128.706187] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:15.137Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7a1814914735b080f9f8c903","created_at":"2026-09-13T10:46:17.400Z","trace_propagation_headers":{"sentry-trace":"a26fe266460f44eb923223c4c5c69504-307d9346073a4e8f","baggage":"sentry-trace_id=a26fe266460f44eb923223c4c5c69504,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"cca6a1fa78206105845ec814136be02b","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-13T10:46:17.407Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7a1814914735b080f9f8c903: done: 0.182487 sec","job_status":"done","queue_duration_s":57.547664,"scheduling_latency_s":57.547724,"redis_calls":31,"redis_duration_s":0.010034,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.006072,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002539,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001423,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.096463098,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.182487,"completed_at":"2026-09-13T10:47:15.137Z","load_balancing_strategy":"primary","db_duration_s":0.052036,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1276gitlab # [ 129.167589] bundle[1574]: {"timestamp":"2026-09-13T10:47:15.599Z","pid":1574,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1277gitlab # [ 129.168573] bundle[1574]: {"timestamp":"2026-09-13T10:47:15.599Z","pid":1574,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1278gitlab # [ 129.169348] bundle[1574]: {"timestamp":"2026-09-13T10:47:15.599Z","pid":1574,"message":"! #\u003cThread:0x000070c4203fadb8 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1279gitlab # [ 129.170058] bundle[1574]: {"timestamp":"2026-09-13T10:47:15.599Z","pid":1574,"message":"! #\u003cThread:0x000070c4205fc968 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1280gitlab # [ 129.170731] bundle[1574]: {"timestamp":"2026-09-13T10:47:15.599Z","pid":1574,"message":"Use Ctrl-C to stop"}1281gitlab # [ 129.171537] bundle[1574]: {"timestamp":"2026-09-13T10:47:15.599Z","pid":1574,"message":"Sending status to systemd every 1.0 sec"}1282gitlab # [ 129.825971] bundle[1574]: {"timestamp":"2026-09-13T10:47:16.258Z","pid":1574,"message":"- Worker 0 (PID: 2144) booted in 0.63s, phase: 0"}1283gitlab # [ 129.859671] bundle[1574]: {"timestamp":"2026-09-13T10:47:16.291Z","pid":1574,"message":"- Worker 1 (PID: 2148) booted in 0.64s, phase: 0"}1284gitlab # [ 129.865731] systemd[1]: Started gitlab.service.1285gitlab # [ 129.866831] systemd[1]: Reached target Common target for all GitLab services..1286gitlab # [ 129.867675] systemd[1]: Starting setup-gitlab.service...1287gitlab # [ 129.900581] setup-gitlab-start[2172]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1288gitlab # [ 131.883807] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:47:18 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 19481289gitlab # [ 131.889139] setup-gitlab-start[2172]: + TOKEN=nixbot-test-token-of-20-chars1290gitlab # [ 131.891157] setup-gitlab-start[2172]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1291gitlab # [ 131.901251] runuser[2191]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1292gitlab # [ 132.260884] setup-gitlab-start[2192]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1293gitlab # [ 132.262569] setup-gitlab-start[2192]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1294gitlab # [ 132.263923] setup-gitlab-start[2192]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1295gitlab # [ 132.829949] setup-gitlab-start[2192]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1296gitlab # [ 132.832237] setup-gitlab-start[2192]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1297gitlab # [ 132.833424] setup-gitlab-start[2192]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1298gitlab # [ 139.853694] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:26.284Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b2a1c7b46f85c660b34e9842","created_at":"2026-09-13T10:47:26.254Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aac190dc1195664fed3fc66cda9b7f6d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.282Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b2a1c7b46f85c660b34e9842: start","job_status":"start","queue_duration_s":0.002645,"scheduling_latency_s":0.002695}1299gitlab # [ 140.066054] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:26.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b2a1c7b46f85c660b34e9842","created_at":"2026-09-13T10:47:26.254Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aac190dc1195664fed3fc66cda9b7f6d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.282Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b2a1c7b46f85c660b34e9842: done: 0.213018 sec","job_status":"done","queue_duration_s":0.002645,"scheduling_latency_s":0.002695,"redis_calls":14,"redis_duration_s":0.008847,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002537,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00281,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0035,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001571428,"exclusive_lock_hold_duration_s":0.13684923699999998,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.213018,"completed_at":"2026-09-13T10:47:26.497Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025321,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 140.121064] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:26.552Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"acc943a722d9d3fadb6a393a","created_at":"2026-09-13T10:47:26.309Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2cc2b09f76adcc4a2aa83b19cca7c31","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.322Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-acc943a722d9d3fadb6a393a: start","job_status":"start","queue_duration_s":0.230585,"scheduling_latency_s":0.230624}1301gitlab # [ 140.166091] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:26.598Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"acc943a722d9d3fadb6a393a","created_at":"2026-09-13T10:47:26.309Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2cc2b09f76adcc4a2aa83b19cca7c31","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.322Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-acc943a722d9d3fadb6a393a: done: 0.045359 sec","job_status":"done","queue_duration_s":0.230585,"scheduling_latency_s":0.230624,"redis_calls":10,"redis_duration_s":0.005104,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000466,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001516,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00256541,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.045359,"completed_at":"2026-09-13T10:47:26.598Z","load_balancing_strategy":"primary","db_duration_s":0.016007,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 140.205864] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:26.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a75fd1e6b3a2873f37f3044e","created_at":"2026-09-13T10:47:26.332Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e026c3bfbed918e31ea4e852188ba9ec","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-13T10:47:26.343Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a75fd1e6b3a2873f37f3044e: start","job_status":"start","queue_duration_s":0.29465,"scheduling_latency_s":0.294692}1303gitlab # [ 140.239411] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:26.671Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1304gitlab # [ 140.283639] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:26.715Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a75fd1e6b3a2873f37f3044e","created_at":"2026-09-13T10:47:26.332Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e026c3bfbed918e31ea4e852188ba9ec","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-13T10:47:26.343Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a75fd1e6b3a2873f37f3044e: done: 0.077508 sec","job_status":"done","queue_duration_s":0.29465,"scheduling_latency_s":0.294692,"redis_calls":10,"redis_duration_s":0.037351,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002385,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.032727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002239,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000806527,"duration_s":0.077508,"completed_at":"2026-09-13T10:47:26.715Z","load_balancing_strategy":"primary","db_duration_s":0.000517,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 140.313130] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:26.723Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"bd06eeff958c8e5668543c57","created_at":"2026-09-13T10:47:26.366Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e24009258a81fce80bf869c44c4ed16","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.374Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-bd06eeff958c8e5668543c57: start","job_status":"start","queue_duration_s":0.349439,"scheduling_latency_s":0.349478}1306gitlab # [ 140.369268] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:26.801Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1307gitlab # [ 140.393900] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:26.825Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"bd06eeff958c8e5668543c57","created_at":"2026-09-13T10:47:26.366Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e24009258a81fce80bf869c44c4ed16","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.374Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-bd06eeff958c8e5668543c57: done: 0.102349 sec","job_status":"done","queue_duration_s":0.349439,"scheduling_latency_s":0.349478,"redis_calls":10,"redis_duration_s":0.059272,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002053,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004401,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.052818,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000410946,"duration_s":0.102349,"completed_at":"2026-09-13T10:47:26.825Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00163,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 140.435835] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:26.868Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"626bb5c487a4945d3baefce4","created_at":"2026-09-13T10:47:26.379Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.386Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-626bb5c487a4945d3baefce4: start","job_status":"start","queue_duration_s":0.481285,"scheduling_latency_s":0.481309}1309gitlab # [ 140.653158] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.085Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"626bb5c487a4945d3baefce4","created_at":"2026-09-13T10:47:26.379Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.386Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-626bb5c487a4945d3baefce4: done: 0.217075 sec","job_status":"done","queue_duration_s":0.481285,"scheduling_latency_s":0.481309,"redis_calls":71,"redis_duration_s":0.06681,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.023455,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001279,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.040713,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001363,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.106903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000296686,"duration_s":0.217075,"completed_at":"2026-09-13T10:47:27.084Z","load_balancing_strategy":"primary","db_duration_s":0.006092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 140.723477] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.155Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"f6c43603897af8276e7825f7","created_at":"2026-09-13T10:47:26.391Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8e5ef93af42d5a26cb04ec50556d9a0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.397Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-f6c43603897af8276e7825f7: start","job_status":"start","queue_duration_s":0.757721,"scheduling_latency_s":0.757767}1311gitlab # [ 140.810315] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.241Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"f6c43603897af8276e7825f7","created_at":"2026-09-13T10:47:26.391Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8e5ef93af42d5a26cb04ec50556d9a0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.397Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-f6c43603897af8276e7825f7: done: 0.086666 sec","job_status":"done","queue_duration_s":0.757721,"scheduling_latency_s":0.757767,"redis_calls":12,"redis_duration_s":0.003539,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00044,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001611,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001488,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001521981,"exclusive_lock_hold_duration_s":0.020044726,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.086666,"completed_at":"2026-09-13T10:47:27.241Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031262,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 140.878470] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.244Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"0dbc71c718979d510871de73","created_at":"2026-09-13T10:47:26.425Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad5a9dec546756828d58852fa997fa80","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.433Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-0dbc71c718979d510871de73: start","job_status":"start","queue_duration_s":0.810519,"scheduling_latency_s":0.810552}1313gitlab # [ 140.891038] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.262Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1314gitlab # [ 140.893951] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.272Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"0dbc71c718979d510871de73","created_at":"2026-09-13T10:47:26.425Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad5a9dec546756828d58852fa997fa80","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.433Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-0dbc71c718979d510871de73: done: 0.028217 sec","job_status":"done","queue_duration_s":0.810519,"scheduling_latency_s":0.810552,"redis_calls":10,"redis_duration_s":0.003031,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000618,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001799,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000614,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051068,"duration_s":0.028217,"completed_at":"2026-09-13T10:47:27.272Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000589,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 140.930639] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.274Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"969152358ecb5606eb229ca1","created_at":"2026-09-13T10:47:26.438Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a5d1f8905354a882d8f3bbd328b6dac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.442Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-969152358ecb5606eb229ca1: start","job_status":"start","queue_duration_s":0.832373,"scheduling_latency_s":0.832441}1316gitlab # [ 140.943489] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.290Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"969152358ecb5606eb229ca1","created_at":"2026-09-13T10:47:26.438Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a5d1f8905354a882d8f3bbd328b6dac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.442Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-969152358ecb5606eb229ca1: done: 0.015911 sec","job_status":"done","queue_duration_s":0.832373,"scheduling_latency_s":0.832441,"redis_calls":12,"redis_duration_s":0.00232,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000828,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001114,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000378,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000258692,"duration_s":0.015911,"completed_at":"2026-09-13T10:47:27.290Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 140.944499] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.291Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2fd01c04967e25cdd7b0b6da","created_at":"2026-09-13T10:47:26.452Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce23246cfca18a1bf3584236d6baad8f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.458Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2fd01c04967e25cdd7b0b6da: start","job_status":"start","queue_duration_s":0.832998,"scheduling_latency_s":0.833037}1318gitlab # [ 140.985925] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.299Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1319gitlab # [ 140.986627] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.310Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2fd01c04967e25cdd7b0b6da","created_at":"2026-09-13T10:47:26.452Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce23246cfca18a1bf3584236d6baad8f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.458Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2fd01c04967e25cdd7b0b6da: done: 0.019368 sec","job_status":"done","queue_duration_s":0.832998,"scheduling_latency_s":0.833037,"redis_calls":10,"redis_duration_s":0.001911,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000409,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001124,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000378,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000253104,"duration_s":0.019368,"completed_at":"2026-09-13T10:47:27.310Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000409,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 140.994546] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.312Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b101ac13640f85e72f52119b","created_at":"2026-09-13T10:47:26.469Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"640b21ba3544995a24396a72ea59bb33","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.481Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b101ac13640f85e72f52119b: start","job_status":"start","queue_duration_s":0.830326,"scheduling_latency_s":0.830339}1321gitlab # [ 141.007223] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.324Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b101ac13640f85e72f52119b","created_at":"2026-09-13T10:47:26.469Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"640b21ba3544995a24396a72ea59bb33","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.481Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b101ac13640f85e72f52119b: done: 0.012939 sec","job_status":"done","queue_duration_s":0.830326,"scheduling_latency_s":0.830339,"redis_calls":10,"redis_duration_s":0.001879,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000383,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001135,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000361,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000280762,"duration_s":0.012939,"completed_at":"2026-09-13T10:47:27.324Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000375,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 141.061020] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.326Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"cdce4435393bb6188c258086","created_at":"2026-09-13T10:47:26.496Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f4d0dd23acbd27cb8f0b5a133f8cc8d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.582Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-cdce4435393bb6188c258086: start","job_status":"start","queue_duration_s":0.743662,"scheduling_latency_s":0.743675}1323gitlab # [ 141.132449] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.564Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"cdce4435393bb6188c258086","created_at":"2026-09-13T10:47:26.496Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f4d0dd23acbd27cb8f0b5a133f8cc8d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.582Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-cdce4435393bb6188c258086: done: 0.238572 sec","job_status":"done","queue_duration_s":0.743662,"scheduling_latency_s":0.743675,"redis_calls":565,"redis_duration_s":0.06569799999999999,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000391,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.064411,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.197402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023774,"duration_s":0.238572,"completed_at":"2026-09-13T10:47:27.564Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 141.152988] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.565Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"2401b1221b160b47c065260a","created_at":"2026-09-13T10:47:26.588Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0e4c6ab4377eb25f80d71aa83bb8794","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-13T10:47:26.599Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-2401b1221b160b47c065260a: start","job_status":"start","queue_duration_s":0.965759,"scheduling_latency_s":0.965797}1325gitlab # [ 141.161610] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"2401b1221b160b47c065260a","created_at":"2026-09-13T10:47:26.588Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0e4c6ab4377eb25f80d71aa83bb8794","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-13T10:47:26.599Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-2401b1221b160b47c065260a: done: 0.02837 sec","job_status":"done","queue_duration_s":0.965759,"scheduling_latency_s":0.965797,"redis_calls":10,"redis_duration_s":0.0013340000000000001,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000813,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222095,"duration_s":0.02837,"completed_at":"2026-09-13T10:47:27.593Z","load_balancing_strategy":"primary","db_duration_s":0.009642,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 141.217339] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.649Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"78e07e0d2ff1adf56b5aa311","created_at":"2026-09-13T10:47:26.647Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59db0ff72eaf3370e729dea65423967d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.665Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-78e07e0d2ff1adf56b5aa311: start","job_status":"start","queue_duration_s":0.984267,"scheduling_latency_s":0.984292}1327gitlab # [ 141.249586] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.681Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"78e07e0d2ff1adf56b5aa311","created_at":"2026-09-13T10:47:26.647Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59db0ff72eaf3370e729dea65423967d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.665Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-78e07e0d2ff1adf56b5aa311: done: 0.032283 sec","job_status":"done","queue_duration_s":0.984267,"scheduling_latency_s":0.984292,"redis_calls":10,"redis_duration_s":0.001493,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000792,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218743,"duration_s":0.032283,"completed_at":"2026-09-13T10:47:27.681Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003471,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 141.287638] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.719Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"52d77b5cd4a3425767de625b","created_at":"2026-09-13T10:47:26.711Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"522f0190a9db1491b4c3052f83c2e6c0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.722Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-52d77b5cd4a3425767de625b: start","job_status":"start","queue_duration_s":0.997018,"scheduling_latency_s":0.997049}1329gitlab # [ 141.317535] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.749Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1330gitlab # [ 141.327957] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.759Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"52d77b5cd4a3425767de625b","created_at":"2026-09-13T10:47:26.711Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"522f0190a9db1491b4c3052f83c2e6c0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.722Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-52d77b5cd4a3425767de625b: done: 0.040339 sec","job_status":"done","queue_duration_s":0.997018,"scheduling_latency_s":0.997049,"redis_calls":10,"redis_duration_s":0.003205,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000796,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000643,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000474642,"duration_s":0.040339,"completed_at":"2026-09-13T10:47:27.759Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000767,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 141.368073] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.800Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d35e2e90cf6699402eba8e6e","created_at":"2026-09-13T10:47:26.790Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d450184394e19445c910c506cd151310","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.806Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d35e2e90cf6699402eba8e6e: start","job_status":"start","queue_duration_s":0.993771,"scheduling_latency_s":0.993813}1332gitlab # [ 141.417159] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.849Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d35e2e90cf6699402eba8e6e","created_at":"2026-09-13T10:47:26.790Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d450184394e19445c910c506cd151310","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.806Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d35e2e90cf6699402eba8e6e: done: 0.049142 sec","job_status":"done","queue_duration_s":0.993771,"scheduling_latency_s":0.993813,"redis_calls":16,"redis_duration_s":0.00473,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002512,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001664,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000554,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000528559,"duration_s":0.049142,"completed_at":"2026-09-13T10:47:27.849Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006467,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 141.456401] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.888Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a26158c106026752a98241c2","created_at":"2026-09-13T10:47:26.822Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0e495fe62a95d962c38c1435a09ac1e","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.884Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a26158c106026752a98241c2: start","job_status":"start","queue_duration_s":1.003773,"scheduling_latency_s":1.003818}1334gitlab # [ 141.498467] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.930Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a26158c106026752a98241c2","created_at":"2026-09-13T10:47:26.822Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0e495fe62a95d962c38c1435a09ac1e","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.884Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a26158c106026752a98241c2: done: 0.042064 sec","job_status":"done","queue_duration_s":1.003773,"scheduling_latency_s":1.003818,"redis_calls":13,"redis_duration_s":0.004059999999999999,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000721,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002008,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001331,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.011414579000000001,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.042064,"completed_at":"2026-09-13T10:47:27.930Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002508,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1335gitlab # [ 141.539116] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:27.971Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"8da4858d5986f4e7ecfb5b54","created_at":"2026-09-13T10:47:26.891Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d9aac0749800d21ee5f0b9c69ff0446","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.906Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-8da4858d5986f4e7ecfb5b54: start","job_status":"start","queue_duration_s":1.064816,"scheduling_latency_s":1.064859}1336gitlab # [ 141.574693] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.006Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"8da4858d5986f4e7ecfb5b54","created_at":"2026-09-13T10:47:26.891Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d9aac0749800d21ee5f0b9c69ff0446","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.906Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-8da4858d5986f4e7ecfb5b54: done: 0.035417 sec","job_status":"done","queue_duration_s":1.064816,"scheduling_latency_s":1.064859,"redis_calls":12,"redis_duration_s":0.004407,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000649,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002366,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001392,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000788927,"exclusive_lock_hold_duration_s":0.004731887,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.035417,"completed_at":"2026-09-13T10:47:28.006Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002113,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 141.615466] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.047Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"01651cd443ccf26c7a1b7dbd","created_at":"2026-09-13T10:47:26.917Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3923acc7288dd4a02d133feee66e1a05","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.928Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-01651cd443ccf26c7a1b7dbd: start","job_status":"start","queue_duration_s":1.11893,"scheduling_latency_s":1.11898}1338gitlab # [ 141.810613] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"01651cd443ccf26c7a1b7dbd","created_at":"2026-09-13T10:47:26.917Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3923acc7288dd4a02d133feee66e1a05","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.928Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-01651cd443ccf26c7a1b7dbd: done: 0.195399 sec","job_status":"done","queue_duration_s":1.11893,"scheduling_latency_s":1.11898,"redis_calls":12,"redis_duration_s":0.0035859999999999998,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000668,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001572,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001346,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.036,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.139352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000841727,"exclusive_lock_hold_duration_s":0.1672978,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.195399,"completed_at":"2026-09-13T10:47:28.242Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.055095,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 141.886882] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.318Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"34ac252e00b8ccf3a210ca36","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce033f256e224049dfacbe88a6e6fbfd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.968Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-34ac252e00b8ccf3a210ca36: start","job_status":"start","queue_duration_s":1.349901,"scheduling_latency_s":1.349951}1340gitlab # [ 141.941195] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.372Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"34ac252e00b8ccf3a210ca36","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce033f256e224049dfacbe88a6e6fbfd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:26.968Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-34ac252e00b8ccf3a210ca36: done: 0.054818 sec","job_status":"done","queue_duration_s":1.349901,"scheduling_latency_s":1.349951,"redis_calls":19,"redis_duration_s":0.005967,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001427,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000486,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003046,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000541968,"duration_s":0.054818,"completed_at":"2026-09-13T10:47:28.372Z","load_balancing_strategy":"primary","db_duration_s":0.002935,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 141.998322] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.430Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f3e47a96e2e0dfb0fe586c27","created_at":"2026-09-13T10:47:26.980Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f72ab8bdb3890ad8b668f19c10d39d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-13T10:47:26.992Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f3e47a96e2e0dfb0fe586c27: start","job_status":"start","queue_duration_s":1.43781,"scheduling_latency_s":1.437858}1342gitlab # [ 142.019416] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.451Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1343gitlab # [ 142.031421] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.463Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f3e47a96e2e0dfb0fe586c27","created_at":"2026-09-13T10:47:26.980Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1f72ab8bdb3890ad8b668f19c10d39d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-13T10:47:26.992Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f3e47a96e2e0dfb0fe586c27: done: 0.033233 sec","job_status":"done","queue_duration_s":1.43781,"scheduling_latency_s":1.437858,"redis_calls":10,"redis_duration_s":0.003126,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000641,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001874,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000611,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000490286,"duration_s":0.033233,"completed_at":"2026-09-13T10:47:28.463Z","load_balancing_strategy":"primary","db_duration_s":0.000757,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 142.069586] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.501Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"24ea11748fec55fd27171c65","created_at":"2026-09-13T10:47:27.004Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9ea5f4b72e918d4a2889af7684a1bd4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.017Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-24ea11748fec55fd27171c65: start","job_status":"start","queue_duration_s":1.484077,"scheduling_latency_s":1.484117}1345gitlab # [ 142.119616] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.551Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"24ea11748fec55fd27171c65","created_at":"2026-09-13T10:47:27.004Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9ea5f4b72e918d4a2889af7684a1bd4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.017Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-24ea11748fec55fd27171c65: done: 0.049999 sec","job_status":"done","queue_duration_s":1.484077,"scheduling_latency_s":1.484117,"redis_calls":12,"redis_duration_s":0.002828,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000487,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001365,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02342,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000733612,"exclusive_lock_hold_duration_s":0.009646478,"duration_s":0.049999,"completed_at":"2026-09-13T10:47:28.551Z","load_balancing_strategy":"primary","db_duration_s":0.004937,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 142.158602] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb045abeffae05ad30ea355b","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb045abeffae05ad30ea355b: start","job_status":"start","queue_duration_s":1.513197,"scheduling_latency_s":1.513247}1347gitlab # [ 142.240863] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb045abeffae05ad30ea355b","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb045abeffae05ad30ea355b: done: 0.082678 sec","job_status":"done","queue_duration_s":1.513197,"scheduling_latency_s":1.513247,"redis_calls":16,"redis_duration_s":0.004854,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000655,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001202,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002997,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000309816,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.082678,"completed_at":"2026-09-13T10:47:28.672Z","load_balancing_strategy":"primary","db_duration_s":0.000943,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 142.307555] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19ee0736146a6918d7594436","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19ee0736146a6918d7594436: start","job_status":"start","queue_duration_s":1.662151,"scheduling_latency_s":1.662199}1349gitlab # [ 142.336401] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19ee0736146a6918d7594436","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19ee0736146a6918d7594436: done: 0.028697 sec","job_status":"done","queue_duration_s":1.662151,"scheduling_latency_s":1.662199,"redis_calls":13,"redis_duration_s":0.005717,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00136,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004357,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028697,"completed_at":"2026-09-13T10:47:28.767Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 142.372948] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0880fb200e69ed855f1135e2","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0880fb200e69ed855f1135e2: start","job_status":"start","queue_duration_s":1.727634,"scheduling_latency_s":1.727677}1351gitlab # [ 142.398384] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0880fb200e69ed855f1135e2","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0880fb200e69ed855f1135e2: done: 0.025339 sec","job_status":"done","queue_duration_s":1.727634,"scheduling_latency_s":1.727677,"redis_calls":13,"redis_duration_s":0.003863,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001274,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002589,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025339,"completed_at":"2026-09-13T10:47:28.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 142.400597] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"861a34097306c23bf591b902","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-861a34097306c23bf591b902: start","job_status":"start","queue_duration_s":1.755479,"scheduling_latency_s":1.755511}1353gitlab # [ 142.440108] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"861a34097306c23bf591b902","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-861a34097306c23bf591b902: done: 0.018209 sec","job_status":"done","queue_duration_s":1.755479,"scheduling_latency_s":1.755511,"redis_calls":13,"redis_duration_s":0.002839,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000885,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018209,"completed_at":"2026-09-13T10:47:28.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 142.441628] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f592f63b508a28f70156cba6","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f592f63b508a28f70156cba6: start","job_status":"start","queue_duration_s":1.774397,"scheduling_latency_s":1.774411}1355gitlab # [ 142.481120] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f592f63b508a28f70156cba6","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f592f63b508a28f70156cba6: done: 0.009209 sec","job_status":"done","queue_duration_s":1.774397,"scheduling_latency_s":1.774411,"redis_calls":13,"redis_duration_s":0.0015990000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009209,"completed_at":"2026-09-13T10:47:28.860Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 142.483786] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c7aa22840aaacb07afb6f36","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c7aa22840aaacb07afb6f36: start","job_status":"start","queue_duration_s":1.784774,"scheduling_latency_s":1.784787}1357gitlab # [ 142.495567] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c7aa22840aaacb07afb6f36","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c7aa22840aaacb07afb6f36: done: 0.009143 sec","job_status":"done","queue_duration_s":1.784774,"scheduling_latency_s":1.784787,"redis_calls":13,"redis_duration_s":0.001515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009143,"completed_at":"2026-09-13T10:47:28.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 142.562768] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"275b769b5796f9b2ba1964ce","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-275b769b5796f9b2ba1964ce: start","job_status":"start","queue_duration_s":1.794782,"scheduling_latency_s":1.794795}1359gitlab # [ 142.563753] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"275b769b5796f9b2ba1964ce","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-275b769b5796f9b2ba1964ce: done: 0.009131 sec","job_status":"done","queue_duration_s":1.794782,"scheduling_latency_s":1.794795,"redis_calls":13,"redis_duration_s":0.001534,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009131,"completed_at":"2026-09-13T10:47:28.881Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 142.604952] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2759211e39fac4694f01c18d","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2759211e39fac4694f01c18d: start","job_status":"start","queue_duration_s":1.804723,"scheduling_latency_s":1.804736}1361gitlab # [ 142.606068] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2759211e39fac4694f01c18d","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2759211e39fac4694f01c18d: done: 0.009086 sec","job_status":"done","queue_duration_s":1.804723,"scheduling_latency_s":1.804736,"redis_calls":13,"redis_duration_s":0.001567,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009086,"completed_at":"2026-09-13T10:47:28.891Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 142.646127] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b77d552d36f4f5f03df75d5f","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b77d552d36f4f5f03df75d5f: start","job_status":"start","queue_duration_s":1.814636,"scheduling_latency_s":1.814648}1363gitlab # [ 142.647188] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b77d552d36f4f5f03df75d5f","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b77d552d36f4f5f03df75d5f: done: 0.009064 sec","job_status":"done","queue_duration_s":1.814636,"scheduling_latency_s":1.814648,"redis_calls":13,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001044,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009064,"completed_at":"2026-09-13T10:47:28.900Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 142.694928] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52210310c5e62285e692fa47","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52210310c5e62285e692fa47: start","job_status":"start","queue_duration_s":1.824898,"scheduling_latency_s":1.824912}1365gitlab # [ 142.695898] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52210310c5e62285e692fa47","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52210310c5e62285e692fa47: done: 0.009011 sec","job_status":"done","queue_duration_s":1.824898,"scheduling_latency_s":1.824912,"redis_calls":13,"redis_duration_s":0.001552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009011,"completed_at":"2026-09-13T10:47:28.911Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 142.735266] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cba6c824d53d698186a17f72","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cba6c824d53d698186a17f72: start","job_status":"start","queue_duration_s":1.834818,"scheduling_latency_s":1.834831}1367gitlab # [ 142.736233] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cba6c824d53d698186a17f72","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cba6c824d53d698186a17f72: done: 0.009126 sec","job_status":"done","queue_duration_s":1.834818,"scheduling_latency_s":1.834831,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009126,"completed_at":"2026-09-13T10:47:28.921Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 142.758116] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fef8c9abc57ef9a3a43de97","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fef8c9abc57ef9a3a43de97: start","job_status":"start","queue_duration_s":1.844809,"scheduling_latency_s":1.844822}1369gitlab # [ 142.806315] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fef8c9abc57ef9a3a43de97","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fef8c9abc57ef9a3a43de97: done: 0.009051 sec","job_status":"done","queue_duration_s":1.844809,"scheduling_latency_s":1.844822,"redis_calls":13,"redis_duration_s":0.001488,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009051,"completed_at":"2026-09-13T10:47:28.931Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 142.807837] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f1bfd90a66de46b30f963fc","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f1bfd90a66de46b30f963fc: start","job_status":"start","queue_duration_s":1.85468,"scheduling_latency_s":1.854693}1371gitlab # [ 142.851069] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f1bfd90a66de46b30f963fc","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f1bfd90a66de46b30f963fc: done: 0.009351 sec","job_status":"done","queue_duration_s":1.85468,"scheduling_latency_s":1.854693,"redis_calls":13,"redis_duration_s":0.001778,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000675,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009351,"completed_at":"2026-09-13T10:47:28.941Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 142.852583] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b752ca87f8bb65d9511b3f0","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b752ca87f8bb65d9511b3f0: start","job_status":"start","queue_duration_s":1.865191,"scheduling_latency_s":1.865204}1373gitlab # [ 142.895930] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b752ca87f8bb65d9511b3f0","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b752ca87f8bb65d9511b3f0: done: 0.009105 sec","job_status":"done","queue_duration_s":1.865191,"scheduling_latency_s":1.865204,"redis_calls":13,"redis_duration_s":0.001512,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009105,"completed_at":"2026-09-13T10:47:28.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 142.897499] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37ea9aa4813b7fd7aacf054e","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37ea9aa4813b7fd7aacf054e: start","job_status":"start","queue_duration_s":1.875108,"scheduling_latency_s":1.87512}1375gitlab # [ 142.904894] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37ea9aa4813b7fd7aacf054e","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37ea9aa4813b7fd7aacf054e: done: 0.009069 sec","job_status":"done","queue_duration_s":1.875108,"scheduling_latency_s":1.87512,"redis_calls":13,"redis_duration_s":0.0015300000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001041,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009069,"completed_at":"2026-09-13T10:47:28.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 142.949054] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d59c1d8f8cc9d172b249cf8d","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d59c1d8f8cc9d172b249cf8d: start","job_status":"start","queue_duration_s":1.884995,"scheduling_latency_s":1.885007}1377gitlab # [ 142.950139] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d59c1d8f8cc9d172b249cf8d","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d59c1d8f8cc9d172b249cf8d: done: 0.009068 sec","job_status":"done","queue_duration_s":1.884995,"scheduling_latency_s":1.885007,"redis_calls":13,"redis_duration_s":0.001536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009068,"completed_at":"2026-09-13T10:47:28.971Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 142.998452] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f866671368c7dd55ba264108","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f866671368c7dd55ba264108: start","job_status":"start","queue_duration_s":1.895112,"scheduling_latency_s":1.895124}1379gitlab # [ 142.999603] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f866671368c7dd55ba264108","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f866671368c7dd55ba264108: done: 0.009102 sec","job_status":"done","queue_duration_s":1.895112,"scheduling_latency_s":1.895124,"redis_calls":13,"redis_duration_s":0.0014789999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009102,"completed_at":"2026-09-13T10:47:28.981Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 143.052475] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0056cd2fce23c05fb30f7f5f","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0056cd2fce23c05fb30f7f5f: start","job_status":"start","queue_duration_s":1.905084,"scheduling_latency_s":1.905097}1381gitlab # [ 143.053747] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0056cd2fce23c05fb30f7f5f","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0056cd2fce23c05fb30f7f5f: done: 0.009023 sec","job_status":"done","queue_duration_s":1.905084,"scheduling_latency_s":1.905097,"redis_calls":13,"redis_duration_s":0.001559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009023,"completed_at":"2026-09-13T10:47:28.991Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 143.077214] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:28.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c3a79d121701b4206a81811","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c3a79d121701b4206a81811: start","job_status":"start","queue_duration_s":1.915004,"scheduling_latency_s":1.915017}1383gitlab # [ 143.088784] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c3a79d121701b4206a81811","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c3a79d121701b4206a81811: done: 0.009024 sec","job_status":"done","queue_duration_s":1.915004,"scheduling_latency_s":1.915017,"redis_calls":13,"redis_duration_s":0.001509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009024,"completed_at":"2026-09-13T10:47:29.001Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 143.136207] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1641986ed05efca1dc5acf45","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1641986ed05efca1dc5acf45: start","job_status":"start","queue_duration_s":1.925127,"scheduling_latency_s":1.92514}1385gitlab # [ 143.136953] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1641986ed05efca1dc5acf45","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1641986ed05efca1dc5acf45: done: 0.009135 sec","job_status":"done","queue_duration_s":1.925127,"scheduling_latency_s":1.92514,"redis_calls":13,"redis_duration_s":0.001857,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000835,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009135,"completed_at":"2026-09-13T10:47:29.011Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 143.198881] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33e60521868fc64db6e80108","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33e60521868fc64db6e80108: start","job_status":"start","queue_duration_s":1.935092,"scheduling_latency_s":1.935105}1387gitlab # [ 143.199603] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33e60521868fc64db6e80108","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33e60521868fc64db6e80108: done: 0.009203 sec","job_status":"done","queue_duration_s":1.935092,"scheduling_latency_s":1.935105,"redis_calls":13,"redis_duration_s":0.0014919999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009203,"completed_at":"2026-09-13T10:47:29.021Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 143.238793] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82154de5d5d72f008675a173","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82154de5d5d72f008675a173: start","job_status":"start","queue_duration_s":1.945116,"scheduling_latency_s":1.945129}1389gitlab # [ 143.239717] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82154de5d5d72f008675a173","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82154de5d5d72f008675a173: done: 0.009011 sec","job_status":"done","queue_duration_s":1.945116,"scheduling_latency_s":1.945129,"redis_calls":13,"redis_duration_s":0.001523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009011,"completed_at":"2026-09-13T10:47:29.031Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 143.257548] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9bba61e6faea887ecd717ff","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9bba61e6faea887ecd717ff: start","job_status":"start","queue_duration_s":1.954918,"scheduling_latency_s":1.95493}1391gitlab # [ 143.268546] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9bba61e6faea887ecd717ff","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9bba61e6faea887ecd717ff: done: 0.009747 sec","job_status":"done","queue_duration_s":1.954918,"scheduling_latency_s":1.95493,"redis_calls":13,"redis_duration_s":0.001693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000682,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009747,"completed_at":"2026-09-13T10:47:29.041Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 143.310243] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"468de34b89e984bf3be17714","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-468de34b89e984bf3be17714: start","job_status":"start","queue_duration_s":1.965495,"scheduling_latency_s":1.965508}1393gitlab # [ 143.313274] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"468de34b89e984bf3be17714","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-468de34b89e984bf3be17714: done: 0.009279 sec","job_status":"done","queue_duration_s":1.965495,"scheduling_latency_s":1.965508,"redis_calls":13,"redis_duration_s":0.001544,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009279,"completed_at":"2026-09-13T10:47:29.051Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 143.348242] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dd9d7dd8544fa8f7aa7d3be","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dd9d7dd8544fa8f7aa7d3be: start","job_status":"start","queue_duration_s":1.9756,"scheduling_latency_s":1.975613}1395gitlab # [ 143.359193] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dd9d7dd8544fa8f7aa7d3be","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dd9d7dd8544fa8f7aa7d3be: done: 0.009393 sec","job_status":"done","queue_duration_s":1.9756,"scheduling_latency_s":1.975613,"redis_calls":13,"redis_duration_s":0.001547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009393,"completed_at":"2026-09-13T10:47:29.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 143.399092] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8261303b4243c429e2883064","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8261303b4243c429e2883064: start","job_status":"start","queue_duration_s":1.985888,"scheduling_latency_s":1.985902}1397gitlab # [ 143.403788] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8261303b4243c429e2883064","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8261303b4243c429e2883064: done: 0.009265 sec","job_status":"done","queue_duration_s":1.985888,"scheduling_latency_s":1.985902,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009265,"completed_at":"2026-09-13T10:47:29.072Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 143.446107] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afb812ce397ce5a460b77a35","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afb812ce397ce5a460b77a35: start","job_status":"start","queue_duration_s":1.996507,"scheduling_latency_s":1.996521}1399gitlab # [ 143.448506] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afb812ce397ce5a460b77a35","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afb812ce397ce5a460b77a35: done: 0.009095 sec","job_status":"done","queue_duration_s":1.996507,"scheduling_latency_s":1.996521,"redis_calls":13,"redis_duration_s":0.0015439999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009095,"completed_at":"2026-09-13T10:47:29.082Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 143.490169] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ffb7d119da65336688e1596","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ffb7d119da65336688e1596: start","job_status":"start","queue_duration_s":2.006472,"scheduling_latency_s":2.006485}1401gitlab # [ 143.493120] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ffb7d119da65336688e1596","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ffb7d119da65336688e1596: done: 0.009018 sec","job_status":"done","queue_duration_s":2.006472,"scheduling_latency_s":2.006485,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005849,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009018,"completed_at":"2026-09-13T10:47:29.092Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 143.545162] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bcb7fbdab1f774e295c5331","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bcb7fbdab1f774e295c5331: start","job_status":"start","queue_duration_s":2.016315,"scheduling_latency_s":2.016353}1403gitlab # [ 143.545894] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bcb7fbdab1f774e295c5331","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bcb7fbdab1f774e295c5331: done: 0.008997 sec","job_status":"done","queue_duration_s":2.016315,"scheduling_latency_s":2.016353,"redis_calls":13,"redis_duration_s":0.001507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008997,"completed_at":"2026-09-13T10:47:29.102Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 143.594186] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1edf8c72b11cb2fa8266f0cf","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1edf8c72b11cb2fa8266f0cf: start","job_status":"start","queue_duration_s":2.026134,"scheduling_latency_s":2.026147}1405gitlab # [ 143.594911] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1edf8c72b11cb2fa8266f0cf","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1edf8c72b11cb2fa8266f0cf: done: 0.009363 sec","job_status":"done","queue_duration_s":2.026134,"scheduling_latency_s":2.026147,"redis_calls":13,"redis_duration_s":0.0014939999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005514,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009363,"completed_at":"2026-09-13T10:47:29.112Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 143.635153] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b24b7ade99a0a5fefae6c88b","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b24b7ade99a0a5fefae6c88b: start","job_status":"start","queue_duration_s":2.036292,"scheduling_latency_s":2.036306}1407gitlab # [ 143.635902] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b24b7ade99a0a5fefae6c88b","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b24b7ade99a0a5fefae6c88b: done: 0.008987 sec","job_status":"done","queue_duration_s":2.036292,"scheduling_latency_s":2.036306,"redis_calls":13,"redis_duration_s":0.0014919999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008987,"completed_at":"2026-09-13T10:47:29.122Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 143.679100] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adb23883793cf2adb3b7e568","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adb23883793cf2adb3b7e568: start","job_status":"start","queue_duration_s":2.046099,"scheduling_latency_s":2.046112}1409gitlab # [ 143.679785] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adb23883793cf2adb3b7e568","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adb23883793cf2adb3b7e568: done: 0.009081 sec","job_status":"done","queue_duration_s":2.046099,"scheduling_latency_s":2.046112,"redis_calls":13,"redis_duration_s":0.0016389999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009081,"completed_at":"2026-09-13T10:47:29.132Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 143.719946] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b9fa731e967c243d8dc2b45","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b9fa731e967c243d8dc2b45: start","job_status":"start","queue_duration_s":2.05602,"scheduling_latency_s":2.056032}1411gitlab # [ 143.720693] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b9fa731e967c243d8dc2b45","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b9fa731e967c243d8dc2b45: done: 0.009317 sec","job_status":"done","queue_duration_s":2.05602,"scheduling_latency_s":2.056032,"redis_calls":13,"redis_duration_s":0.0017820000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001281,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009317,"completed_at":"2026-09-13T10:47:29.142Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 143.752193] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df35000bddf96023680ccf82","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df35000bddf96023680ccf82: start","job_status":"start","queue_duration_s":2.066312,"scheduling_latency_s":2.066324}1413gitlab # [ 143.789875] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df35000bddf96023680ccf82","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df35000bddf96023680ccf82: done: 0.008864 sec","job_status":"done","queue_duration_s":2.066312,"scheduling_latency_s":2.066324,"redis_calls":13,"redis_duration_s":0.001507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008864,"completed_at":"2026-09-13T10:47:29.152Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 143.796586] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b2fc7b378a2ec87aff08fcc","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b2fc7b378a2ec87aff08fcc: start","job_status":"start","queue_duration_s":2.075993,"scheduling_latency_s":2.076007}1415gitlab # [ 143.807628] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b2fc7b378a2ec87aff08fcc","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b2fc7b378a2ec87aff08fcc: done: 0.008894 sec","job_status":"done","queue_duration_s":2.075993,"scheduling_latency_s":2.076007,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008894,"completed_at":"2026-09-13T10:47:29.162Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 143.857137] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56bb3cdfc348bdd9bf2354a1","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56bb3cdfc348bdd9bf2354a1: start","job_status":"start","queue_duration_s":2.085753,"scheduling_latency_s":2.085766}1417gitlab # [ 143.857875] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56bb3cdfc348bdd9bf2354a1","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56bb3cdfc348bdd9bf2354a1: done: 0.008929 sec","job_status":"done","queue_duration_s":2.085753,"scheduling_latency_s":2.085766,"redis_calls":13,"redis_duration_s":0.001572,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008929,"completed_at":"2026-09-13T10:47:29.171Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 143.923207] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97f124f0ba9d5856459932ab","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97f124f0ba9d5856459932ab: start","job_status":"start","queue_duration_s":2.095537,"scheduling_latency_s":2.095549}1419gitlab # [ 143.923906] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97f124f0ba9d5856459932ab","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97f124f0ba9d5856459932ab: done: 0.008965 sec","job_status":"done","queue_duration_s":2.095537,"scheduling_latency_s":2.095549,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008965,"completed_at":"2026-09-13T10:47:29.181Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 143.931210] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a7879c03f8ba885e88541eb","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a7879c03f8ba885e88541eb: start","job_status":"start","queue_duration_s":2.10536,"scheduling_latency_s":2.105373}1421gitlab # [ 143.941813] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a7879c03f8ba885e88541eb","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a7879c03f8ba885e88541eb: done: 0.008945 sec","job_status":"done","queue_duration_s":2.10536,"scheduling_latency_s":2.105373,"redis_calls":13,"redis_duration_s":0.001531,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008945,"completed_at":"2026-09-13T10:47:29.191Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 144.003640] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"069c8b35ccfc65707132b284","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-069c8b35ccfc65707132b284: start","job_status":"start","queue_duration_s":2.115112,"scheduling_latency_s":2.115124}1423gitlab # [ 144.004488] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"069c8b35ccfc65707132b284","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-069c8b35ccfc65707132b284: done: 0.009188 sec","job_status":"done","queue_duration_s":2.115112,"scheduling_latency_s":2.115124,"redis_calls":13,"redis_duration_s":0.0015149999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009188,"completed_at":"2026-09-13T10:47:29.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 144.020083] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9085689f2d27086c8a1fa57","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9085689f2d27086c8a1fa57: start","job_status":"start","queue_duration_s":2.125183,"scheduling_latency_s":2.125196}1425gitlab # [ 144.031116] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9085689f2d27086c8a1fa57","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9085689f2d27086c8a1fa57: done: 0.008889 sec","job_status":"done","queue_duration_s":2.125183,"scheduling_latency_s":2.125196,"redis_calls":13,"redis_duration_s":0.001533,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008889,"completed_at":"2026-09-13T10:47:29.211Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 144.071782] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59f5195680587cdcc72bf10b","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59f5195680587cdcc72bf10b: start","job_status":"start","queue_duration_s":2.135047,"scheduling_latency_s":2.13506}1427gitlab # [ 144.109685] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59f5195680587cdcc72bf10b","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59f5195680587cdcc72bf10b: done: 0.009051 sec","job_status":"done","queue_duration_s":2.135047,"scheduling_latency_s":2.13506,"redis_calls":13,"redis_duration_s":0.001606,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009051,"completed_at":"2026-09-13T10:47:29.221Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 144.110696] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8472b99e48c172974e60781f","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8472b99e48c172974e60781f: start","job_status":"start","queue_duration_s":2.145009,"scheduling_latency_s":2.145022}1429gitlab # [ 144.119242] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8472b99e48c172974e60781f","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8472b99e48c172974e60781f: done: 0.008981 sec","job_status":"done","queue_duration_s":2.145009,"scheduling_latency_s":2.145022,"redis_calls":13,"redis_duration_s":0.001524,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008981,"completed_at":"2026-09-13T10:47:29.231Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 144.164436] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.232Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca3c89a7a5f87ad1df4b18ed","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca3c89a7a5f87ad1df4b18ed: start","job_status":"start","queue_duration_s":2.15483,"scheduling_latency_s":2.154843}1431gitlab # [ 144.165069] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca3c89a7a5f87ad1df4b18ed","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca3c89a7a5f87ad1df4b18ed: done: 0.009131 sec","job_status":"done","queue_duration_s":2.15483,"scheduling_latency_s":2.154843,"redis_calls":13,"redis_duration_s":0.0017439999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000668,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001076,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009131,"completed_at":"2026-09-13T10:47:29.241Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 144.203073] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18939b422f2c485bf2d484bd","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18939b422f2c485bf2d484bd: start","job_status":"start","queue_duration_s":2.164846,"scheduling_latency_s":2.16486}1433gitlab # [ 144.207918] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18939b422f2c485bf2d484bd","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18939b422f2c485bf2d484bd: done: 0.008945 sec","job_status":"done","queue_duration_s":2.164846,"scheduling_latency_s":2.16486,"redis_calls":13,"redis_duration_s":0.001629,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008945,"completed_at":"2026-09-13T10:47:29.250Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 144.253038] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee02c4a4d16b6a780636b999","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee02c4a4d16b6a780636b999: start","job_status":"start","queue_duration_s":2.174704,"scheduling_latency_s":2.174717}1435gitlab # [ 144.253624] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee02c4a4d16b6a780636b999","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee02c4a4d16b6a780636b999: done: 0.008931 sec","job_status":"done","queue_duration_s":2.174704,"scheduling_latency_s":2.174717,"redis_calls":13,"redis_duration_s":0.0015409999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008931,"completed_at":"2026-09-13T10:47:29.260Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 144.294987] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fd20a2e11dc9c17c01d9bd1","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fd20a2e11dc9c17c01d9bd1: start","job_status":"start","queue_duration_s":2.184506,"scheduling_latency_s":2.184519}1437gitlab # [ 144.296591] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fd20a2e11dc9c17c01d9bd1","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fd20a2e11dc9c17c01d9bd1: done: 0.008993 sec","job_status":"done","queue_duration_s":2.184506,"scheduling_latency_s":2.184519,"redis_calls":13,"redis_duration_s":0.001541,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008993,"completed_at":"2026-09-13T10:47:29.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 144.344568] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7e971b963ec5edd73837c1f","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7e971b963ec5edd73837c1f: start","job_status":"start","queue_duration_s":2.194355,"scheduling_latency_s":2.194367}1439gitlab # [ 144.345688] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7e971b963ec5edd73837c1f","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7e971b963ec5edd73837c1f: done: 0.00886 sec","job_status":"done","queue_duration_s":2.194355,"scheduling_latency_s":2.194367,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00886,"completed_at":"2026-09-13T10:47:29.280Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 144.378335] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc348c1442660c65fe7310f2","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc348c1442660c65fe7310f2: start","job_status":"start","queue_duration_s":2.204054,"scheduling_latency_s":2.204068}1441gitlab # [ 144.425543] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc348c1442660c65fe7310f2","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc348c1442660c65fe7310f2: done: 0.008913 sec","job_status":"done","queue_duration_s":2.204054,"scheduling_latency_s":2.204068,"redis_calls":13,"redis_duration_s":0.001537,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008913,"completed_at":"2026-09-13T10:47:29.290Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 144.426685] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb31d1677003a7fb28dd8bec","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb31d1677003a7fb28dd8bec: start","job_status":"start","queue_duration_s":2.213966,"scheduling_latency_s":2.213986}1443gitlab # [ 144.433791] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb31d1677003a7fb28dd8bec","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb31d1677003a7fb28dd8bec: done: 0.008878 sec","job_status":"done","queue_duration_s":2.213966,"scheduling_latency_s":2.213986,"redis_calls":13,"redis_duration_s":0.0015329999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008878,"completed_at":"2026-09-13T10:47:29.300Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 144.486978] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87dc2574986fabfa3539aa93","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87dc2574986fabfa3539aa93: start","job_status":"start","queue_duration_s":2.223732,"scheduling_latency_s":2.223745}1445gitlab # [ 144.487725] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87dc2574986fabfa3539aa93","created_at":"2026-09-13T10:47:26.949Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8b8f340774534a53","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4e112a9134a8a856939ea654b7ae5d11","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:27.077Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87dc2574986fabfa3539aa93: done: 0.009199 sec","job_status":"done","queue_duration_s":2.223732,"scheduling_latency_s":2.223745,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009199,"completed_at":"2026-09-13T10:47:29.310Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 144.513668] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.311Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"48856cddb9254a0f429f321b","created_at":"2026-09-13T10:47:28.343Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-e4691ba56cc44fbe","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce033f256e224049dfacbe88a6e6fbfd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:28.360Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-48856cddb9254a0f429f321b: start","job_status":"start","queue_duration_s":0.950438,"scheduling_latency_s":0.950451}1447gitlab # [ 144.524791] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.322Z","message":"No existing merge request to be cleaned up."}1448gitlab # [ 144.526200] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.330Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"48856cddb9254a0f429f321b","created_at":"2026-09-13T10:47:28.343Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-e4691ba56cc44fbe","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce033f256e224049dfacbe88a6e6fbfd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:28.360Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-48856cddb9254a0f429f321b: done: 0.019526 sec","job_status":"done","queue_duration_s":0.950438,"scheduling_latency_s":0.950451,"redis_calls":13,"redis_duration_s":0.0016510000000000001,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000603,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000773,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000207848,"duration_s":0.019526,"completed_at":"2026-09-13T10:47:29.330Z","load_balancing_strategy":"primary","db_duration_s":0.0042,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 144.577077] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.331Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c8b1b744ef6b55a864d0f9e3","created_at":"2026-09-13T10:47:28.343Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-e4691ba56cc44fbe","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce033f256e224049dfacbe88a6e6fbfd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:28.360Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c8b1b744ef6b55a864d0f9e3: start","job_status":"start","queue_duration_s":0.971194,"scheduling_latency_s":0.971207}1450gitlab # [ 144.577736] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.340Z","message":"No existing merge request to be cleaned up."}1451gitlab # [ 144.578270] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.346Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c8b1b744ef6b55a864d0f9e3","created_at":"2026-09-13T10:47:28.343Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-e4691ba56cc44fbe","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce033f256e224049dfacbe88a6e6fbfd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:28.360Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c8b1b744ef6b55a864d0f9e3: done: 0.014745 sec","job_status":"done","queue_duration_s":0.971194,"scheduling_latency_s":0.971207,"redis_calls":10,"redis_duration_s":0.001359,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000781,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014745,"completed_at":"2026-09-13T10:47:29.346Z","load_balancing_strategy":"primary","db_duration_s":0.006753,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 144.607176] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.347Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"df9781d741f8f3220f825568","created_at":"2026-09-13T10:47:28.343Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-e4691ba56cc44fbe","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce033f256e224049dfacbe88a6e6fbfd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:28.360Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-df9781d741f8f3220f825568: start","job_status":"start","queue_duration_s":0.986793,"scheduling_latency_s":0.986806}1453gitlab # [ 144.618093] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.353Z","message":"No existing merge request to be cleaned up."}1454gitlab # [ 144.619682] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.358Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"df9781d741f8f3220f825568","created_at":"2026-09-13T10:47:28.343Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-e4691ba56cc44fbe","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce033f256e224049dfacbe88a6e6fbfd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:28.360Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-df9781d741f8f3220f825568: done: 0.011131 sec","job_status":"done","queue_duration_s":0.986793,"scheduling_latency_s":0.986806,"redis_calls":10,"redis_duration_s":0.001333,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000784,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011131,"completed_at":"2026-09-13T10:47:29.358Z","load_balancing_strategy":"primary","db_duration_s":0.001511,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 144.664615] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.359Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3f2fe0fab4161edcd390f43a","created_at":"2026-09-13T10:47:28.343Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-e4691ba56cc44fbe","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce033f256e224049dfacbe88a6e6fbfd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:28.360Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3f2fe0fab4161edcd390f43a: start","job_status":"start","queue_duration_s":0.998792,"scheduling_latency_s":0.998805}1456gitlab # [ 144.665200] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.365Z","message":"No existing merge request to be cleaned up."}1457gitlab # [ 144.665721] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:47:29.370Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3f2fe0fab4161edcd390f43a","created_at":"2026-09-13T10:47:28.343Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-e4691ba56cc44fbe","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce033f256e224049dfacbe88a6e6fbfd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:47:28.360Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3f2fe0fab4161edcd390f43a: done: 0.011044 sec","job_status":"done","queue_duration_s":0.998792,"scheduling_latency_s":0.998805,"redis_calls":10,"redis_duration_s":0.001232,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000723,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011044,"completed_at":"2026-09-13T10:47:29.370Z","load_balancing_strategy":"primary","db_duration_s":0.001493,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 144.881741] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2465575712 wd_nsec: 24655753911459gitlab # [ 157.489116] setup-gitlab-start[2192]: W, [2026-09-13T10:47:43.920704 #2192] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1460gitlab # [ 176.533628] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:02.964Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"d3333b0afac6c37c35a793db","created_at":"2026-09-13T10:48:02.914Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a6f24a8584529f9d59c58b30bc53b392","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:02.962Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-d3333b0afac6c37c35a793db: start","job_status":"start","queue_duration_s":0.002004,"scheduling_latency_s":0.002108}1461gitlab # [ 176.606527] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.038Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"d3333b0afac6c37c35a793db","created_at":"2026-09-13T10:48:02.914Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a6f24a8584529f9d59c58b30bc53b392","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:02.962Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-d3333b0afac6c37c35a793db: done: 0.074478 sec","job_status":"done","queue_duration_s":0.002004,"scheduling_latency_s":0.002108,"redis_calls":12,"redis_duration_s":0.007106,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.001157,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000533,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003769,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001647,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001327264,"duration_s":0.074478,"completed_at":"2026-09-13T10:48:03.038Z","load_balancing_strategy":"primary","db_duration_s":0.008228,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 176.651150] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.083Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a1f008adf41b6b1d5f0a6de7","created_at":"2026-09-13T10:48:02.969Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c00f7513d678d03f07373810b550fa8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:02.974Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a1f008adf41b6b1d5f0a6de7: start","job_status":"start","queue_duration_s":0.108484,"scheduling_latency_s":0.108502}1463gitlab # [ 176.727514] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.159Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a1f008adf41b6b1d5f0a6de7","created_at":"2026-09-13T10:48:02.969Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c00f7513d678d03f07373810b550fa8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:02.974Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a1f008adf41b6b1d5f0a6de7: done: 0.076707 sec","job_status":"done","queue_duration_s":0.108484,"scheduling_latency_s":0.108502,"redis_calls":9,"redis_duration_s":0.004235,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00187,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002365,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000365968,"exclusive_lock_hold_duration_s":0.052226191,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.076707,"completed_at":"2026-09-13T10:48:03.159Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037068,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 176.767639] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.199Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"47aa81abb4a7565640f74e08","created_at":"2026-09-13T10:48:02.988Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad6dec7e6a6a0fdc58bd8846f178f8d2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:02.996Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-47aa81abb4a7565640f74e08: start","job_status":"start","queue_duration_s":0.203588,"scheduling_latency_s":0.203617}1465gitlab # [ 176.817197] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.249Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"47aa81abb4a7565640f74e08","created_at":"2026-09-13T10:48:02.988Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad6dec7e6a6a0fdc58bd8846f178f8d2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:02.996Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-47aa81abb4a7565640f74e08: done: 0.049282 sec","job_status":"done","queue_duration_s":0.203588,"scheduling_latency_s":0.203617,"redis_calls":7,"redis_duration_s":0.0053360000000000005,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004327,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.049282,"completed_at":"2026-09-13T10:48:03.249Z","load_balancing_strategy":"primary","db_duration_s":0.019875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 176.820537] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b96dd5dbe16056424beaf429","created_at":"2026-09-13T10:48:03.002Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83b6754fecb23fae31470f3b8927ce40","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-13T10:48:03.004Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b96dd5dbe16056424beaf429: start","job_status":"start","queue_duration_s":0.248756,"scheduling_latency_s":0.248774}1467gitlab # [ 176.826718] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.259Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1468gitlab # [ 176.835269] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b96dd5dbe16056424beaf429","created_at":"2026-09-13T10:48:03.002Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83b6754fecb23fae31470f3b8927ce40","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-13T10:48:03.004Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b96dd5dbe16056424beaf429: done: 0.014336 sec","job_status":"done","queue_duration_s":0.248756,"scheduling_latency_s":0.248774,"redis_calls":7,"redis_duration_s":0.000938,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000661,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014336,"completed_at":"2026-09-13T10:48:03.267Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 176.888892] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.281Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"da41ef86f0b422147fe521ae","created_at":"2026-09-13T10:48:03.008Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d161a535512c10559bb1949dd257e23","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.010Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-da41ef86f0b422147fe521ae: start","job_status":"start","queue_duration_s":0.27121,"scheduling_latency_s":0.271246}1470gitlab # [ 176.889599] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.299Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1471gitlab # [ 176.890069] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.310Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"da41ef86f0b422147fe521ae","created_at":"2026-09-13T10:48:03.008Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d161a535512c10559bb1949dd257e23","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.010Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-da41ef86f0b422147fe521ae: done: 0.029174 sec","job_status":"done","queue_duration_s":0.27121,"scheduling_latency_s":0.271246,"redis_calls":7,"redis_duration_s":0.004011,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002289,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001722,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029174,"completed_at":"2026-09-13T10:48:03.310Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 176.934763] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.314Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"85b776eccca9f2c02ac8f06c","created_at":"2026-09-13T10:48:03.015Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.019Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-85b776eccca9f2c02ac8f06c: start","job_status":"start","queue_duration_s":0.295743,"scheduling_latency_s":0.29577}1473gitlab # [ 176.951663] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.383Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"85b776eccca9f2c02ac8f06c","created_at":"2026-09-13T10:48:03.015Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.019Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-85b776eccca9f2c02ac8f06c: done: 0.068978 sec","job_status":"done","queue_duration_s":0.295743,"scheduling_latency_s":0.29577,"redis_calls":60,"redis_duration_s":0.010085,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000591,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.008859,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000635,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.068978,"completed_at":"2026-09-13T10:48:03.383Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 176.962592] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.384Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"0e112c11421e1be0b2ab586a","created_at":"2026-09-13T10:48:03.030Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b583af27fc448a0ff24155315cbf9dce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.036Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-0e112c11421e1be0b2ab586a: start","job_status":"start","queue_duration_s":0.348582,"scheduling_latency_s":0.348599}1475gitlab # [ 176.985625] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.417Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"0e112c11421e1be0b2ab586a","created_at":"2026-09-13T10:48:03.030Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b583af27fc448a0ff24155315cbf9dce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.036Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-0e112c11421e1be0b2ab586a: done: 0.032966 sec","job_status":"done","queue_duration_s":0.348582,"scheduling_latency_s":0.348599,"redis_calls":9,"redis_duration_s":0.002012,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001003,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000516267,"exclusive_lock_hold_duration_s":0.012908903,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.032966,"completed_at":"2026-09-13T10:48:03.417Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 177.025782] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.418Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"b7b1f4dbfaf981575c73a89a","created_at":"2026-09-13T10:48:03.083Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6066e3cd3939d0d82db6de6bfbd3cbf","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.098Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-b7b1f4dbfaf981575c73a89a: start","job_status":"start","queue_duration_s":0.320504,"scheduling_latency_s":0.320518}1477gitlab # [ 177.026779] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.435Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"b7b1f4dbfaf981575c73a89a","created_at":"2026-09-13T10:48:03.083Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6066e3cd3939d0d82db6de6bfbd3cbf","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.098Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-b7b1f4dbfaf981575c73a89a: done: 0.016568 sec","job_status":"done","queue_duration_s":0.320504,"scheduling_latency_s":0.320518,"redis_calls":12,"redis_duration_s":0.002602,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000434,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001214,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000412064,"exclusive_lock_hold_duration_s":0.003944357,"duration_s":0.016568,"completed_at":"2026-09-13T10:48:03.435Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 177.065079] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"55e93d1f79df8de2d58017cd","created_at":"2026-09-13T10:48:03.101Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52a95b763cc4424843482a94659c45e0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.102Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-55e93d1f79df8de2d58017cd: start","job_status":"start","queue_duration_s":0.33409,"scheduling_latency_s":0.334103}1479gitlab # [ 177.077780] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.441Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1480gitlab # [ 177.116858] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.444Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"55e93d1f79df8de2d58017cd","created_at":"2026-09-13T10:48:03.101Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52a95b763cc4424843482a94659c45e0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.102Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-55e93d1f79df8de2d58017cd: done: 0.007989 sec","job_status":"done","queue_duration_s":0.33409,"scheduling_latency_s":0.334103,"redis_calls":7,"redis_duration_s":0.001498,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001064,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007989,"completed_at":"2026-09-13T10:48:03.444Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 177.118460] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.445Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"08918183cf2e8e01eea9828e","created_at":"2026-09-13T10:48:03.109Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8300ac05bb3d9405a66dd020c1652478","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.113Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-08918183cf2e8e01eea9828e: start","job_status":"start","queue_duration_s":0.331826,"scheduling_latency_s":0.331839}1482gitlab # [ 177.163890] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.453Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"08918183cf2e8e01eea9828e","created_at":"2026-09-13T10:48:03.109Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8300ac05bb3d9405a66dd020c1652478","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.113Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-08918183cf2e8e01eea9828e: done: 0.008249 sec","job_status":"done","queue_duration_s":0.331826,"scheduling_latency_s":0.331839,"redis_calls":7,"redis_duration_s":0.0014509999999999998,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001035,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000416,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008249,"completed_at":"2026-09-13T10:48:03.453Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 177.164955] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.454Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"f915c82387e48c45a6848f3c","created_at":"2026-09-13T10:48:03.118Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.121Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-f915c82387e48c45a6848f3c: start","job_status":"start","queue_duration_s":0.333118,"scheduling_latency_s":0.33313}1484gitlab # [ 177.175487] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.517Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"f915c82387e48c45a6848f3c","created_at":"2026-09-13T10:48:03.118Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.121Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-f915c82387e48c45a6848f3c: done: 0.06219 sec","job_status":"done","queue_duration_s":0.333118,"scheduling_latency_s":0.33313,"redis_calls":65,"redis_duration_s":0.014556,"redis_read_bytes":115,"redis_write_bytes":41282,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000891,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.000635,"redis_queues_read_bytes":4,"redis_queues_write_bytes":36985,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.012392,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000638,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032155,"duration_s":0.06219,"completed_at":"2026-09-13T10:48:03.517Z","load_balancing_strategy":"primary","db_duration_s":0.000853,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 177.213225] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.518Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"190960fe2335eeab24527242","created_at":"2026-09-13T10:48:03.128Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ce8355c76651e69da48278bacfaf367","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.129Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-190960fe2335eeab24527242: start","job_status":"start","queue_duration_s":0.388379,"scheduling_latency_s":0.388392}1486gitlab # [ 177.252606] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.523Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1487gitlab # [ 177.253228] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.526Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"190960fe2335eeab24527242","created_at":"2026-09-13T10:48:03.128Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ce8355c76651e69da48278bacfaf367","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.129Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-190960fe2335eeab24527242: done: 0.008294 sec","job_status":"done","queue_duration_s":0.388379,"scheduling_latency_s":0.388392,"redis_calls":7,"redis_duration_s":0.0015580000000000001,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001092,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008294,"completed_at":"2026-09-13T10:48:03.526Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 177.291784] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.527Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"32e678fd092f37a0028db290","created_at":"2026-09-13T10:48:03.145Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b91dd78f0cf672c395a2a7521b7a1c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.149Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-32e678fd092f37a0028db290: start","job_status":"start","queue_duration_s":0.37861,"scheduling_latency_s":0.378623}1489gitlab # [ 177.292781] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.535Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"32e678fd092f37a0028db290","created_at":"2026-09-13T10:48:03.145Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b91dd78f0cf672c395a2a7521b7a1c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.149Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-32e678fd092f37a0028db290: done: 0.008171 sec","job_status":"done","queue_duration_s":0.37861,"scheduling_latency_s":0.378623,"redis_calls":7,"redis_duration_s":0.001478,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008171,"completed_at":"2026-09-13T10:48:03.535Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 177.331449] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"080ab4f1e3b1af4c2225b933","created_at":"2026-09-13T10:48:03.160Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2ed497585cd6c0eb32c01b259bac3a7","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.161Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-080ab4f1e3b1af4c2225b933: start","job_status":"start","queue_duration_s":0.375385,"scheduling_latency_s":0.375398}1491gitlab # [ 177.374276] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.806Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"080ab4f1e3b1af4c2225b933","created_at":"2026-09-13T10:48:03.160Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2ed497585cd6c0eb32c01b259bac3a7","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.161Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-080ab4f1e3b1af4c2225b933: done: 0.269352 sec","job_status":"done","queue_duration_s":0.375385,"scheduling_latency_s":0.375398,"redis_calls":562,"redis_duration_s":0.09539700000000001,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.094475,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.204144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.269352,"completed_at":"2026-09-13T10:48:03.806Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 177.411107] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.843Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"e755b4895b77c1b0bd8abfcf","created_at":"2026-09-13T10:48:03.203Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aea9c8b930359b32064dda3df0569c5a","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.211Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-e755b4895b77c1b0bd8abfcf: start","job_status":"start","queue_duration_s":0.631642,"scheduling_latency_s":0.631666}1493gitlab # [ 177.435436] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.867Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"e755b4895b77c1b0bd8abfcf","created_at":"2026-09-13T10:48:03.203Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aea9c8b930359b32064dda3df0569c5a","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.211Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-e755b4895b77c1b0bd8abfcf: done: 0.024373 sec","job_status":"done","queue_duration_s":0.631642,"scheduling_latency_s":0.631666,"redis_calls":10,"redis_duration_s":0.001448,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000208965,"duration_s":0.024373,"completed_at":"2026-09-13T10:48:03.867Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003992,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 177.473882] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.905Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"baf08d94caf4111fb2ea49a6","created_at":"2026-09-13T10:48:03.215Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"220b5a26657701f01fc64bda814f3411","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-13T10:48:03.216Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-baf08d94caf4111fb2ea49a6: start","job_status":"start","queue_duration_s":0.689343,"scheduling_latency_s":0.689373}1495gitlab # [ 177.508323] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.940Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"baf08d94caf4111fb2ea49a6","created_at":"2026-09-13T10:48:03.215Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"220b5a26657701f01fc64bda814f3411","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-13T10:48:03.216Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-baf08d94caf4111fb2ea49a6: done: 0.03456 sec","job_status":"done","queue_duration_s":0.689343,"scheduling_latency_s":0.689373,"redis_calls":7,"redis_duration_s":0.001815,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0013,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000515,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03456,"completed_at":"2026-09-13T10:48:03.940Z","load_balancing_strategy":"primary","db_duration_s":0.002318,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 177.545741] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:03.977Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6f66586c8e26f1f4e3860e37","created_at":"2026-09-13T10:48:03.219Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d493940f26e087dd38e83e20d0aa41a5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.220Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6f66586c8e26f1f4e3860e37: start","job_status":"start","queue_duration_s":0.756486,"scheduling_latency_s":0.756513}1497gitlab # [ 177.581913] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.013Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6f66586c8e26f1f4e3860e37","created_at":"2026-09-13T10:48:03.219Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d493940f26e087dd38e83e20d0aa41a5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.220Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6f66586c8e26f1f4e3860e37: done: 0.036768 sec","job_status":"done","queue_duration_s":0.756486,"scheduling_latency_s":0.756513,"redis_calls":7,"redis_duration_s":0.002584,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00175,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000834,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036768,"completed_at":"2026-09-13T10:48:04.013Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001404,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 177.620142] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.052Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"11ea4b5b4d83d4c2319fcd6f","created_at":"2026-09-13T10:48:03.231Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4ed2e557e276271120935dce9012d02","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.236Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-11ea4b5b4d83d4c2319fcd6f: start","job_status":"start","queue_duration_s":0.815275,"scheduling_latency_s":0.815321}1499gitlab # [ 177.631907] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.064Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1500gitlab # [ 177.639636] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.071Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"11ea4b5b4d83d4c2319fcd6f","created_at":"2026-09-13T10:48:03.231Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4ed2e557e276271120935dce9012d02","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.236Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-11ea4b5b4d83d4c2319fcd6f: done: 0.019512 sec","job_status":"done","queue_duration_s":0.815275,"scheduling_latency_s":0.815321,"redis_calls":7,"redis_duration_s":0.002176,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001532,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000644,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019512,"completed_at":"2026-09-13T10:48:04.071Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 177.641349] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.073Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"83b8f4ed54d0999bb5a3ed91","created_at":"2026-09-13T10:48:03.246Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"044db86f62be82c894201ea4e6e74657","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.247Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-83b8f4ed54d0999bb5a3ed91: start","job_status":"start","queue_duration_s":0.825888,"scheduling_latency_s":0.825918}1502gitlab # [ 177.665153] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.097Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"83b8f4ed54d0999bb5a3ed91","created_at":"2026-09-13T10:48:03.246Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"044db86f62be82c894201ea4e6e74657","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.247Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-83b8f4ed54d0999bb5a3ed91: done: 0.023707 sec","job_status":"done","queue_duration_s":0.825888,"scheduling_latency_s":0.825918,"redis_calls":7,"redis_duration_s":0.0021650000000000003,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001575,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00059,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023707,"completed_at":"2026-09-13T10:48:04.097Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004285,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 177.713804] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.098Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e677e8a2fca9e530d960888a","created_at":"2026-09-13T10:48:03.254Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5f92513fd8aef54d4fed25eea8d14a7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.264Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e677e8a2fca9e530d960888a: start","job_status":"start","queue_duration_s":0.834642,"scheduling_latency_s":0.834667}1504gitlab # [ 177.714785] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.120Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e677e8a2fca9e530d960888a","created_at":"2026-09-13T10:48:03.254Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5f92513fd8aef54d4fed25eea8d14a7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.264Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e677e8a2fca9e530d960888a: done: 0.02202 sec","job_status":"done","queue_duration_s":0.834642,"scheduling_latency_s":0.834667,"redis_calls":10,"redis_duration_s":0.002617,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001578,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00600663,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.02202,"completed_at":"2026-09-13T10:48:04.120Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004249,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1505gitlab # [ 177.759519] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.121Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"6e51b0fbfac16b16cb1c44db","created_at":"2026-09-13T10:48:03.269Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62e92130ff33f033b17251f5bd97a733","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.270Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-6e51b0fbfac16b16cb1c44db: start","job_status":"start","queue_duration_s":0.851209,"scheduling_latency_s":0.851222}1506gitlab # [ 177.760591] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.132Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"6e51b0fbfac16b16cb1c44db","created_at":"2026-09-13T10:48:03.269Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62e92130ff33f033b17251f5bd97a733","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.270Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-6e51b0fbfac16b16cb1c44db: done: 0.010773 sec","job_status":"done","queue_duration_s":0.851209,"scheduling_latency_s":0.851222,"redis_calls":9,"redis_duration_s":0.001926,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000864,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000380775,"exclusive_lock_hold_duration_s":0.00213854,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.010773,"completed_at":"2026-09-13T10:48:04.132Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001198,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 177.800435] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.133Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"6e2327d44014d48478b2bea0","created_at":"2026-09-13T10:48:03.272Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14c3c13c630ef3d860a1341165c1a1d8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.274Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-6e2327d44014d48478b2bea0: start","job_status":"start","queue_duration_s":0.859131,"scheduling_latency_s":0.859144}1508gitlab # [ 177.838662] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.270Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"6e2327d44014d48478b2bea0","created_at":"2026-09-13T10:48:03.272Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14c3c13c630ef3d860a1341165c1a1d8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.274Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-6e2327d44014d48478b2bea0: done: 0.137064 sec","job_status":"done","queue_duration_s":0.859131,"scheduling_latency_s":0.859144,"redis_calls":11,"redis_duration_s":0.002326,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000415,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001051,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00086,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.103808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000359822,"exclusive_lock_hold_duration_s":0.125159482,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.137064,"completed_at":"2026-09-13T10:48:04.270Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03862,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 177.859250] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.272Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"4b6948bf447cc5ee42725f89","created_at":"2026-09-13T10:48:03.281Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2de0b1db4962d8cb0aa60569c24dbaf3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.283Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-4b6948bf447cc5ee42725f89: start","job_status":"start","queue_duration_s":0.988683,"scheduling_latency_s":0.988714}1510gitlab # [ 177.859879] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.291Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"4b6948bf447cc5ee42725f89","created_at":"2026-09-13T10:48:03.281Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2de0b1db4962d8cb0aa60569c24dbaf3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.283Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-4b6948bf447cc5ee42725f89: done: 0.019133 sec","job_status":"done","queue_duration_s":0.988683,"scheduling_latency_s":0.988714,"redis_calls":14,"redis_duration_s":0.001935,"redis_read_bytes":17,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000251,"redis_queues_read_bytes":4,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000413,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019133,"completed_at":"2026-09-13T10:48:04.291Z","load_balancing_strategy":"primary","db_duration_s":0.00094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 177.912852] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.292Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"9f6be66ffbebee0c43eb693f","created_at":"2026-09-13T10:48:03.286Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"303e745a9bb7941b3177273cb6e95da9","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.295Z","job_size_bytes":3,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-9f6be66ffbebee0c43eb693f: start","job_status":"start","queue_duration_s":0.997291,"scheduling_latency_s":0.997305}1512gitlab # [ 177.913648] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.304Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"9f6be66ffbebee0c43eb693f","created_at":"2026-09-13T10:48:03.286Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"303e745a9bb7941b3177273cb6e95da9","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.295Z","job_size_bytes":3,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-9f6be66ffbebee0c43eb693f: done: 0.011781 sec","job_status":"done","queue_duration_s":0.997291,"scheduling_latency_s":0.997305,"redis_calls":10,"redis_duration_s":0.001228,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000251,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000718,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000230756,"duration_s":0.011781,"completed_at":"2026-09-13T10:48:04.304Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001374,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 177.957948] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"4cf1cb36d350eecd90855e59","created_at":"2026-09-13T10:48:03.303Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2bbb74072e531a35ba7a43d3d080289","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-13T10:48:03.305Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-4cf1cb36d350eecd90855e59: start","job_status":"start","queue_duration_s":0.99948,"scheduling_latency_s":0.999495}1514gitlab # [ 177.958732] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.309Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1515gitlab # [ 177.959140] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.312Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"4cf1cb36d350eecd90855e59","created_at":"2026-09-13T10:48:03.303Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2bbb74072e531a35ba7a43d3d080289","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-13T10:48:03.305Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-4cf1cb36d350eecd90855e59: done: 0.007254 sec","job_status":"done","queue_duration_s":0.99948,"scheduling_latency_s":0.999495,"redis_calls":7,"redis_duration_s":0.0009249999999999999,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007254,"completed_at":"2026-09-13T10:48:04.312Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 177.983126] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"34f430ff785f33d090ac98ea","created_at":"2026-09-13T10:48:03.312Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"430a0634be96211b6860580011e37534","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.313Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-34f430ff785f33d090ac98ea: start","job_status":"start","queue_duration_s":0.999067,"scheduling_latency_s":0.999079}1517gitlab # [ 177.995248] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.322Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"34f430ff785f33d090ac98ea","created_at":"2026-09-13T10:48:03.312Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"430a0634be96211b6860580011e37534","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.313Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-34f430ff785f33d090ac98ea: done: 0.009183 sec","job_status":"done","queue_duration_s":0.999067,"scheduling_latency_s":0.999079,"redis_calls":9,"redis_duration_s":0.001168,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000554,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000279365,"exclusive_lock_hold_duration_s":0.001800229,"duration_s":0.009183,"completed_at":"2026-09-13T10:48:04.322Z","load_balancing_strategy":"primary","db_duration_s":0.000563,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 178.053830] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.323Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"d835bf9743030f714d451303","created_at":"2026-09-13T10:48:03.316Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0d8410f83aac9f7cbe4a1b619973f99","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.320Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-d835bf9743030f714d451303: start","job_status":"start","queue_duration_s":1.002127,"scheduling_latency_s":1.00214}1519gitlab # [ 178.054698] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.333Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"d835bf9743030f714d451303","created_at":"2026-09-13T10:48:03.316Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-396a7223fb4646c0","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0d8410f83aac9f7cbe4a1b619973f99","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.320Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-d835bf9743030f714d451303: done: 0.010572 sec","job_status":"done","queue_duration_s":1.002127,"scheduling_latency_s":1.00214,"redis_calls":12,"redis_duration_s":0.001445,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000485,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194438,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.010572,"completed_at":"2026-09-13T10:48:04.333Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000231,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 178.082449] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4181b2b049afe526607317e0","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4181b2b049afe526607317e0: start","job_status":"start","queue_duration_s":0.955617,"scheduling_latency_s":0.955629}1521gitlab # [ 178.093505] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4181b2b049afe526607317e0","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4181b2b049afe526607317e0: done: 0.008969 sec","job_status":"done","queue_duration_s":0.955617,"scheduling_latency_s":0.955629,"redis_calls":13,"redis_duration_s":0.001504,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008969,"completed_at":"2026-09-13T10:48:04.343Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 178.135623] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.344Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d8b599d12c6557b43e4d875","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d8b599d12c6557b43e4d875: start","job_status":"start","queue_duration_s":0.965403,"scheduling_latency_s":0.965415}1523gitlab # [ 178.138552] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d8b599d12c6557b43e4d875","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d8b599d12c6557b43e4d875: done: 0.008867 sec","job_status":"done","queue_duration_s":0.965403,"scheduling_latency_s":0.965415,"redis_calls":13,"redis_duration_s":0.001538,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008867,"completed_at":"2026-09-13T10:48:04.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 178.177993] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdb3d4b8aab1ed9c06ec0624","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdb3d4b8aab1ed9c06ec0624: start","job_status":"start","queue_duration_s":0.975137,"scheduling_latency_s":0.97515}1525gitlab # [ 178.183182] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdb3d4b8aab1ed9c06ec0624","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdb3d4b8aab1ed9c06ec0624: done: 0.008703 sec","job_status":"done","queue_duration_s":0.975137,"scheduling_latency_s":0.97515,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008703,"completed_at":"2026-09-13T10:48:04.362Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 178.238724] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7326ac38dc30b0f3b90abd2","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7326ac38dc30b0f3b90abd2: start","job_status":"start","queue_duration_s":0.984626,"scheduling_latency_s":0.984639}1527gitlab # [ 178.239606] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7326ac38dc30b0f3b90abd2","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7326ac38dc30b0f3b90abd2: done: 0.008699 sec","job_status":"done","queue_duration_s":0.984626,"scheduling_latency_s":0.984639,"redis_calls":13,"redis_duration_s":0.001452,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000469,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008699,"completed_at":"2026-09-13T10:48:04.372Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 178.291809] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6d23c4eaecdbbf8348fc376","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6d23c4eaecdbbf8348fc376: start","job_status":"start","queue_duration_s":0.994137,"scheduling_latency_s":0.99415}1529gitlab # [ 178.292781] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6d23c4eaecdbbf8348fc376","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6d23c4eaecdbbf8348fc376: done: 0.008737 sec","job_status":"done","queue_duration_s":0.994137,"scheduling_latency_s":0.99415,"redis_calls":13,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008737,"completed_at":"2026-09-13T10:48:04.381Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 178.334203] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6671d76b6280264bc460580e","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6671d76b6280264bc460580e: start","job_status":"start","queue_duration_s":1.00367,"scheduling_latency_s":1.003683}1531gitlab # [ 178.334797] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6671d76b6280264bc460580e","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6671d76b6280264bc460580e: done: 0.00879 sec","job_status":"done","queue_duration_s":1.00367,"scheduling_latency_s":1.003683,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00879,"completed_at":"2026-09-13T10:48:04.391Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 178.381438] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38438ce51dea027b1c2b552e","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38438ce51dea027b1c2b552e: start","job_status":"start","queue_duration_s":1.013297,"scheduling_latency_s":1.01331}1533gitlab # [ 178.382432] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38438ce51dea027b1c2b552e","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38438ce51dea027b1c2b552e: done: 0.00882 sec","job_status":"done","queue_duration_s":1.013297,"scheduling_latency_s":1.01331,"redis_calls":13,"redis_duration_s":0.001601,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00882,"completed_at":"2026-09-13T10:48:04.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 178.430705] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49dae86a94d8fee55c64dd21","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49dae86a94d8fee55c64dd21: start","job_status":"start","queue_duration_s":1.022937,"scheduling_latency_s":1.02295}1535gitlab # [ 178.431586] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49dae86a94d8fee55c64dd21","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49dae86a94d8fee55c64dd21: done: 0.009035 sec","job_status":"done","queue_duration_s":1.022937,"scheduling_latency_s":1.02295,"redis_calls":13,"redis_duration_s":0.001512,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009035,"completed_at":"2026-09-13T10:48:04.410Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 178.476632] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e912b669db18efc840071788","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e912b669db18efc840071788: start","job_status":"start","queue_duration_s":1.032812,"scheduling_latency_s":1.032825}1537gitlab # [ 178.477741] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e912b669db18efc840071788","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e912b669db18efc840071788: done: 0.008818 sec","job_status":"done","queue_duration_s":1.032812,"scheduling_latency_s":1.032825,"redis_calls":13,"redis_duration_s":0.0014910000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008818,"completed_at":"2026-09-13T10:48:04.420Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 178.489526] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33a863d7632fcc16b7bd8ab4","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33a863d7632fcc16b7bd8ab4: start","job_status":"start","queue_duration_s":1.042451,"scheduling_latency_s":1.042463}1539gitlab # [ 178.533696] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33a863d7632fcc16b7bd8ab4","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33a863d7632fcc16b7bd8ab4: done: 0.008783 sec","job_status":"done","queue_duration_s":1.042451,"scheduling_latency_s":1.042463,"redis_calls":13,"redis_duration_s":0.001497,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008783,"completed_at":"2026-09-13T10:48:04.430Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 178.534718] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c771d506173967be845b56bf","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c771d506173967be845b56bf: start","job_status":"start","queue_duration_s":1.052052,"scheduling_latency_s":1.052065}1541gitlab # [ 178.578986] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c771d506173967be845b56bf","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c771d506173967be845b56bf: done: 0.008848 sec","job_status":"done","queue_duration_s":1.052052,"scheduling_latency_s":1.052065,"redis_calls":13,"redis_duration_s":0.0015930000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008848,"completed_at":"2026-09-13T10:48:04.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 178.579597] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"630922829fe551cd6a11167b","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-630922829fe551cd6a11167b: start","job_status":"start","queue_duration_s":1.061704,"scheduling_latency_s":1.061717}1543gitlab # [ 178.590603] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"630922829fe551cd6a11167b","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-630922829fe551cd6a11167b: done: 0.008865 sec","job_status":"done","queue_duration_s":1.061704,"scheduling_latency_s":1.061717,"redis_calls":13,"redis_duration_s":0.001527,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008865,"completed_at":"2026-09-13T10:48:04.449Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 178.636148] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35a46ea2bfee1672e15e0278","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35a46ea2bfee1672e15e0278: start","job_status":"start","queue_duration_s":1.071462,"scheduling_latency_s":1.071475}1545gitlab # [ 178.636606] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35a46ea2bfee1672e15e0278","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35a46ea2bfee1672e15e0278: done: 0.008735 sec","job_status":"done","queue_duration_s":1.071462,"scheduling_latency_s":1.071475,"redis_calls":13,"redis_duration_s":0.0014919999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008735,"completed_at":"2026-09-13T10:48:04.458Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 178.692077] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4f9f540430a8e294be507e1","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4f9f540430a8e294be507e1: start","job_status":"start","queue_duration_s":1.081005,"scheduling_latency_s":1.081017}1547gitlab # [ 178.692804] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4f9f540430a8e294be507e1","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4f9f540430a8e294be507e1: done: 0.008786 sec","job_status":"done","queue_duration_s":1.081005,"scheduling_latency_s":1.081017,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008786,"completed_at":"2026-09-13T10:48:04.468Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 178.744775] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65f15487b93335c05d1a6bfa","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65f15487b93335c05d1a6bfa: start","job_status":"start","queue_duration_s":1.090592,"scheduling_latency_s":1.090605}1549gitlab # [ 178.745611] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65f15487b93335c05d1a6bfa","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65f15487b93335c05d1a6bfa: done: 0.008681 sec","job_status":"done","queue_duration_s":1.090592,"scheduling_latency_s":1.090605,"redis_calls":13,"redis_duration_s":0.001461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000466,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008681,"completed_at":"2026-09-13T10:48:04.478Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 178.758760] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c48ee72f6580812419c4db2d","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c48ee72f6580812419c4db2d: start","job_status":"start","queue_duration_s":1.100075,"scheduling_latency_s":1.100088}1551gitlab # [ 178.769749] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c48ee72f6580812419c4db2d","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c48ee72f6580812419c4db2d: done: 0.008716 sec","job_status":"done","queue_duration_s":1.100075,"scheduling_latency_s":1.100088,"redis_calls":13,"redis_duration_s":0.001508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008716,"completed_at":"2026-09-13T10:48:04.487Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 178.805823] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d9b7edb8c781b6e4e09bf73","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d9b7edb8c781b6e4e09bf73: start","job_status":"start","queue_duration_s":1.109591,"scheduling_latency_s":1.109605}1553gitlab # [ 178.851621] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.497Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d9b7edb8c781b6e4e09bf73","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d9b7edb8c781b6e4e09bf73: done: 0.008895 sec","job_status":"done","queue_duration_s":1.109591,"scheduling_latency_s":1.109605,"redis_calls":13,"redis_duration_s":0.00156,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008895,"completed_at":"2026-09-13T10:48:04.497Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 178.852683] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c49110cf0f17c9468848072b","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c49110cf0f17c9468848072b: start","job_status":"start","queue_duration_s":1.119298,"scheduling_latency_s":1.119312}1555gitlab # [ 178.861138] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c49110cf0f17c9468848072b","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c49110cf0f17c9468848072b: done: 0.008979 sec","job_status":"done","queue_duration_s":1.119298,"scheduling_latency_s":1.119312,"redis_calls":13,"redis_duration_s":0.001611,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008979,"completed_at":"2026-09-13T10:48:04.507Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 178.922789] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20f9dcbfce7016821d580e53","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20f9dcbfce7016821d580e53: start","job_status":"start","queue_duration_s":1.129095,"scheduling_latency_s":1.129107}1557gitlab # [ 178.923634] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20f9dcbfce7016821d580e53","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20f9dcbfce7016821d580e53: done: 0.009046 sec","job_status":"done","queue_duration_s":1.129095,"scheduling_latency_s":1.129107,"redis_calls":13,"redis_duration_s":0.0017079999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00069,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009046,"completed_at":"2026-09-13T10:48:04.516Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558gitlab # [ 178.975594] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8c8680f6ab47b0c6d27350d","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8c8680f6ab47b0c6d27350d: start","job_status":"start","queue_duration_s":1.139007,"scheduling_latency_s":1.139019}1559gitlab # [ 178.976632] postgres[2381]: [2381] ERROR: relation "table_without_models" does not exist1560gitlab # [ 178.977429] postgres[2381]: [2381] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1561gitlab # [ 178.977905] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8c8680f6ab47b0c6d27350d","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8c8680f6ab47b0c6d27350d: done: 0.008883 sec","job_status":"done","queue_duration_s":1.139007,"scheduling_latency_s":1.139019,"redis_calls":13,"redis_duration_s":0.00154,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008883,"completed_at":"2026-09-13T10:48:04.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562gitlab # [ 179.019735] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a99379d11018452c62d5f144","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a99379d11018452c62d5f144: start","job_status":"start","queue_duration_s":1.14871,"scheduling_latency_s":1.148723}1563gitlab # [ 179.020590] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a99379d11018452c62d5f144","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a99379d11018452c62d5f144: done: 0.008794 sec","job_status":"done","queue_duration_s":1.14871,"scheduling_latency_s":1.148723,"redis_calls":13,"redis_duration_s":0.0015800000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008794,"completed_at":"2026-09-13T10:48:04.536Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1564gitlab # [ 179.062664] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6fe01c4419d0110e5ac3ed9","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6fe01c4419d0110e5ac3ed9: start","job_status":"start","queue_duration_s":1.158345,"scheduling_latency_s":1.158358}1565gitlab # [ 179.063524] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6fe01c4419d0110e5ac3ed9","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6fe01c4419d0110e5ac3ed9: done: 0.008708 sec","job_status":"done","queue_duration_s":1.158345,"scheduling_latency_s":1.158358,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008708,"completed_at":"2026-09-13T10:48:04.545Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1566gitlab # [ 179.076053] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f3f94ec499fd734ee26844b","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f3f94ec499fd734ee26844b: start","job_status":"start","queue_duration_s":1.16788,"scheduling_latency_s":1.167893}1567gitlab # [ 179.087161] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f3f94ec499fd734ee26844b","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f3f94ec499fd734ee26844b: done: 0.00868 sec","job_status":"done","queue_duration_s":1.16788,"scheduling_latency_s":1.167893,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00868,"completed_at":"2026-09-13T10:48:04.555Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1568gitlab # [ 179.129835] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e9231d97218004e5488f263","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e9231d97218004e5488f263: start","job_status":"start","queue_duration_s":1.177338,"scheduling_latency_s":1.177351}1569gitlab # [ 179.167586] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e9231d97218004e5488f263","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e9231d97218004e5488f263: done: 0.008618 sec","job_status":"done","queue_duration_s":1.177338,"scheduling_latency_s":1.177351,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008618,"completed_at":"2026-09-13T10:48:04.564Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1570gitlab # [ 179.168616] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f37906b5bdfb297c14cd1fc4","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f37906b5bdfb297c14cd1fc4: start","job_status":"start","queue_duration_s":1.186728,"scheduling_latency_s":1.186761}1571gitlab # [ 179.175895] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f37906b5bdfb297c14cd1fc4","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f37906b5bdfb297c14cd1fc4: done: 0.00886 sec","job_status":"done","queue_duration_s":1.186728,"scheduling_latency_s":1.186761,"redis_calls":13,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00886,"completed_at":"2026-09-13T10:48:04.574Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1572gitlab # [ 179.217063] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"960b1b3428d4945caf74c058","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-960b1b3428d4945caf74c058: start","job_status":"start","queue_duration_s":1.196398,"scheduling_latency_s":1.196412}1573gitlab # [ 179.220140] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"960b1b3428d4945caf74c058","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-960b1b3428d4945caf74c058: done: 0.008704 sec","job_status":"done","queue_duration_s":1.196398,"scheduling_latency_s":1.196412,"redis_calls":13,"redis_duration_s":0.001485,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008704,"completed_at":"2026-09-13T10:48:04.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1574gitlab # [ 179.285674] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"294eddb5438e92bd2ed5d455","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-294eddb5438e92bd2ed5d455: start","job_status":"start","queue_duration_s":1.205892,"scheduling_latency_s":1.205904}1575gitlab # [ 179.286612] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"294eddb5438e92bd2ed5d455","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-294eddb5438e92bd2ed5d455: done: 0.008679 sec","job_status":"done","queue_duration_s":1.205892,"scheduling_latency_s":1.205904,"redis_calls":13,"redis_duration_s":0.001491,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000469,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008679,"completed_at":"2026-09-13T10:48:04.593Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1576gitlab # [ 179.324565] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae13328ef5b5bcf7d189fe76","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae13328ef5b5bcf7d189fe76: start","job_status":"start","queue_duration_s":1.215358,"scheduling_latency_s":1.215371}1577gitlab # [ 179.325214] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae13328ef5b5bcf7d189fe76","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae13328ef5b5bcf7d189fe76: done: 0.008687 sec","job_status":"done","queue_duration_s":1.215358,"scheduling_latency_s":1.215371,"redis_calls":13,"redis_duration_s":0.001581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008687,"completed_at":"2026-09-13T10:48:04.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1578gitlab # [ 179.343493] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4217fd2b6953f24e45049291","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4217fd2b6953f24e45049291: start","job_status":"start","queue_duration_s":1.224851,"scheduling_latency_s":1.224863}1579gitlab # [ 179.381638] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4217fd2b6953f24e45049291","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4217fd2b6953f24e45049291: done: 0.008909 sec","job_status":"done","queue_duration_s":1.224851,"scheduling_latency_s":1.224863,"redis_calls":13,"redis_duration_s":0.001733,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008909,"completed_at":"2026-09-13T10:48:04.612Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580gitlab # [ 179.387875] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ede05bb670cfb5647c1e2ec","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ede05bb670cfb5647c1e2ec: start","job_status":"start","queue_duration_s":1.23465,"scheduling_latency_s":1.234663}1581gitlab # [ 179.398756] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ede05bb670cfb5647c1e2ec","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ede05bb670cfb5647c1e2ec: done: 0.008879 sec","job_status":"done","queue_duration_s":1.23465,"scheduling_latency_s":1.234663,"redis_calls":13,"redis_duration_s":0.0015819999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008879,"completed_at":"2026-09-13T10:48:04.622Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1582gitlab # [ 179.439994] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d750eb026c1958dd45ebf071","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d750eb026c1958dd45ebf071: start","job_status":"start","queue_duration_s":1.244359,"scheduling_latency_s":1.244372}1583gitlab # [ 179.443420] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d750eb026c1958dd45ebf071","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d750eb026c1958dd45ebf071: done: 0.00888 sec","job_status":"done","queue_duration_s":1.244359,"scheduling_latency_s":1.244372,"redis_calls":13,"redis_duration_s":0.001571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00888,"completed_at":"2026-09-13T10:48:04.632Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1584gitlab # [ 179.482269] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b928ec3a71472b6840e28d25","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b928ec3a71472b6840e28d25: start","job_status":"start","queue_duration_s":1.254081,"scheduling_latency_s":1.254095}1585gitlab # [ 179.524538] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b928ec3a71472b6840e28d25","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b928ec3a71472b6840e28d25: done: 0.008768 sec","job_status":"done","queue_duration_s":1.254081,"scheduling_latency_s":1.254095,"redis_calls":13,"redis_duration_s":0.0015300000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008768,"completed_at":"2026-09-13T10:48:04.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1586gitlab # [ 179.525740] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09b8b1f1ad436001e425d38a","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09b8b1f1ad436001e425d38a: start","job_status":"start","queue_duration_s":1.263647,"scheduling_latency_s":1.26366}1587gitlab # [ 179.532464] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09b8b1f1ad436001e425d38a","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09b8b1f1ad436001e425d38a: done: 0.008616 sec","job_status":"done","queue_duration_s":1.263647,"scheduling_latency_s":1.26366,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008616,"completed_at":"2026-09-13T10:48:04.651Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1588gitlab # [ 179.589051] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7da3fce53e2b26275843e387","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7da3fce53e2b26275843e387: start","job_status":"start","queue_duration_s":1.273066,"scheduling_latency_s":1.273079}1589gitlab # [ 179.589772] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7da3fce53e2b26275843e387","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7da3fce53e2b26275843e387: done: 0.008592 sec","job_status":"done","queue_duration_s":1.273066,"scheduling_latency_s":1.273079,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008592,"completed_at":"2026-09-13T10:48:04.660Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1590gitlab # [ 179.640233] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bf12b34bf1ca0a73227f4f8","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bf12b34bf1ca0a73227f4f8: start","job_status":"start","queue_duration_s":1.282491,"scheduling_latency_s":1.282504}1591gitlab # [ 179.640941] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bf12b34bf1ca0a73227f4f8","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bf12b34bf1ca0a73227f4f8: done: 0.00862 sec","job_status":"done","queue_duration_s":1.282491,"scheduling_latency_s":1.282504,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00862,"completed_at":"2026-09-13T10:48:04.669Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1592gitlab # [ 179.656474] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41c6ed5eefb6724a75f9a2e0","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41c6ed5eefb6724a75f9a2e0: start","job_status":"start","queue_duration_s":1.291913,"scheduling_latency_s":1.291926}1593gitlab # [ 179.667577] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41c6ed5eefb6724a75f9a2e0","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41c6ed5eefb6724a75f9a2e0: done: 0.008892 sec","job_status":"done","queue_duration_s":1.291913,"scheduling_latency_s":1.291926,"redis_calls":13,"redis_duration_s":0.0015729999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008892,"completed_at":"2026-09-13T10:48:04.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1594gitlab # [ 179.720288] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6a3e9cb5515ef25f7f51f39","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6a3e9cb5515ef25f7f51f39: start","job_status":"start","queue_duration_s":1.301648,"scheduling_latency_s":1.301661}1595gitlab # [ 179.720929] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6a3e9cb5515ef25f7f51f39","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6a3e9cb5515ef25f7f51f39: done: 0.011057 sec","job_status":"done","queue_duration_s":1.301648,"scheduling_latency_s":1.301661,"redis_calls":13,"redis_duration_s":0.003576,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011057,"completed_at":"2026-09-13T10:48:04.691Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1596gitlab # [ 179.746955] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e81c49ac4b36b1ca37d037f1","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e81c49ac4b36b1ca37d037f1: start","job_status":"start","queue_duration_s":1.313536,"scheduling_latency_s":1.313549}1597gitlab # [ 179.786817] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e81c49ac4b36b1ca37d037f1","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e81c49ac4b36b1ca37d037f1: done: 0.008828 sec","job_status":"done","queue_duration_s":1.313536,"scheduling_latency_s":1.313549,"redis_calls":13,"redis_duration_s":0.001518,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008828,"completed_at":"2026-09-13T10:48:04.701Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1598gitlab # [ 179.825511] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fea0bca8c8bcb1ccbd2a733a","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fea0bca8c8bcb1ccbd2a733a: start","job_status":"start","queue_duration_s":1.323266,"scheduling_latency_s":1.323279}1599gitlab # [ 179.826169] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fea0bca8c8bcb1ccbd2a733a","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fea0bca8c8bcb1ccbd2a733a: done: 0.00879 sec","job_status":"done","queue_duration_s":1.323266,"scheduling_latency_s":1.323279,"redis_calls":13,"redis_duration_s":0.00155,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00879,"completed_at":"2026-09-13T10:48:04.710Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1600gitlab # [ 179.835699] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82f1d78bbb770b5964aedc2b","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82f1d78bbb770b5964aedc2b: start","job_status":"start","queue_duration_s":1.333025,"scheduling_latency_s":1.333038}1601gitlab # [ 179.877216] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82f1d78bbb770b5964aedc2b","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82f1d78bbb770b5964aedc2b: done: 0.018565 sec","job_status":"done","queue_duration_s":1.333025,"scheduling_latency_s":1.333038,"redis_calls":13,"redis_duration_s":0.001879,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018565,"completed_at":"2026-09-13T10:48:04.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1602gitlab # [ 179.914572] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3f5777898315661c313aea6","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3f5777898315661c313aea6: start","job_status":"start","queue_duration_s":1.352468,"scheduling_latency_s":1.352481}1603gitlab # [ 179.915269] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3f5777898315661c313aea6","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3f5777898315661c313aea6: done: 0.011214 sec","job_status":"done","queue_duration_s":1.352468,"scheduling_latency_s":1.352481,"redis_calls":13,"redis_duration_s":0.0017330000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001206,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011214,"completed_at":"2026-09-13T10:48:04.742Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1604gitlab # [ 179.955886] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26f5b2f90c72b49a4dc71cef","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26f5b2f90c72b49a4dc71cef: start","job_status":"start","queue_duration_s":1.364772,"scheduling_latency_s":1.364793}1605gitlab # [ 179.956724] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26f5b2f90c72b49a4dc71cef","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26f5b2f90c72b49a4dc71cef: done: 0.009873 sec","job_status":"done","queue_duration_s":1.364772,"scheduling_latency_s":1.364793,"redis_calls":13,"redis_duration_s":0.001468,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009873,"completed_at":"2026-09-13T10:48:04.753Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1606gitlab # [ 179.969657] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"349eb07755a3db57bc5cbd7e","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-349eb07755a3db57bc5cbd7e: start","job_status":"start","queue_duration_s":1.375937,"scheduling_latency_s":1.375949}1607gitlab # [ 180.014672] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"349eb07755a3db57bc5cbd7e","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-349eb07755a3db57bc5cbd7e: done: 0.009161 sec","job_status":"done","queue_duration_s":1.375937,"scheduling_latency_s":1.375949,"redis_calls":13,"redis_duration_s":0.001486,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009161,"completed_at":"2026-09-13T10:48:04.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1608gitlab # [ 180.015692] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de0b746ff8a34e53aa4b1abc","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de0b746ff8a34e53aa4b1abc: start","job_status":"start","queue_duration_s":1.385918,"scheduling_latency_s":1.38593}1609gitlab # [ 180.025468] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de0b746ff8a34e53aa4b1abc","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de0b746ff8a34e53aa4b1abc: done: 0.00916 sec","job_status":"done","queue_duration_s":1.385918,"scheduling_latency_s":1.38593,"redis_calls":13,"redis_duration_s":0.001508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00916,"completed_at":"2026-09-13T10:48:04.773Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1610gitlab # [ 180.060226] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"522dc30bbae3581415de7e7d","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-522dc30bbae3581415de7e7d: start","job_status":"start","queue_duration_s":1.395969,"scheduling_latency_s":1.395981}1611gitlab # [ 180.102693] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"522dc30bbae3581415de7e7d","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-522dc30bbae3581415de7e7d: done: 0.01206 sec","job_status":"done","queue_duration_s":1.395969,"scheduling_latency_s":1.395981,"redis_calls":13,"redis_duration_s":0.0026869999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007703,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01206,"completed_at":"2026-09-13T10:48:04.786Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1612gitlab # [ 180.104658] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.787Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff21511b8e978afd776605d0","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff21511b8e978afd776605d0: start","job_status":"start","queue_duration_s":1.409036,"scheduling_latency_s":1.409053}1613gitlab # [ 180.145956] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff21511b8e978afd776605d0","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff21511b8e978afd776605d0: done: 0.011314 sec","job_status":"done","queue_duration_s":1.409036,"scheduling_latency_s":1.409053,"redis_calls":13,"redis_duration_s":0.0026420000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011314,"completed_at":"2026-09-13T10:48:04.799Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1614gitlab # [ 180.149389] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b78504e9907cc7142626381f","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b78504e9907cc7142626381f: start","job_status":"start","queue_duration_s":1.421478,"scheduling_latency_s":1.421492}1615gitlab # [ 180.193612] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b78504e9907cc7142626381f","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b78504e9907cc7142626381f: done: 0.011156 sec","job_status":"done","queue_duration_s":1.421478,"scheduling_latency_s":1.421492,"redis_calls":13,"redis_duration_s":0.00262,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001765,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011156,"completed_at":"2026-09-13T10:48:04.811Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1616gitlab # [ 180.194552] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c585f72483c9a69c32f23ed","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c585f72483c9a69c32f23ed: start","job_status":"start","queue_duration_s":1.434068,"scheduling_latency_s":1.43408}1617gitlab # [ 180.204976] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c585f72483c9a69c32f23ed","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c585f72483c9a69c32f23ed: done: 0.009384 sec","job_status":"done","queue_duration_s":1.434068,"scheduling_latency_s":1.43408,"redis_calls":13,"redis_duration_s":0.0015929999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009384,"completed_at":"2026-09-13T10:48:04.822Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1618gitlab # [ 180.273319] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2669bf900cf1e895be12fa8e","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2669bf900cf1e895be12fa8e: start","job_status":"start","queue_duration_s":1.44427,"scheduling_latency_s":1.444282}1619gitlab # [ 180.274078] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2669bf900cf1e895be12fa8e","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2669bf900cf1e895be12fa8e: done: 0.009173 sec","job_status":"done","queue_duration_s":1.44427,"scheduling_latency_s":1.444282,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009173,"completed_at":"2026-09-13T10:48:04.832Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1620gitlab # [ 180.311631] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5cd888ea3cc6bace9a14ec7","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5cd888ea3cc6bace9a14ec7: start","job_status":"start","queue_duration_s":1.454279,"scheduling_latency_s":1.454292}1621gitlab # [ 180.312247] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5cd888ea3cc6bace9a14ec7","created_at":"2026-09-13T10:48:03.334Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-7f056fcbb3af4f4c","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d0166f0150cd360e855d9f905e38d98d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.378Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5cd888ea3cc6bace9a14ec7: done: 0.009745 sec","job_status":"done","queue_duration_s":1.454279,"scheduling_latency_s":1.454292,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009745,"completed_at":"2026-09-13T10:48:04.842Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1622gitlab # [ 180.351288] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"533efef2610755b5c08095ba","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-533efef2610755b5c08095ba: start","job_status":"start","queue_duration_s":1.332884,"scheduling_latency_s":1.332897}1623gitlab # [ 180.351630] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"533efef2610755b5c08095ba","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-533efef2610755b5c08095ba: done: 0.020862 sec","job_status":"done","queue_duration_s":1.332884,"scheduling_latency_s":1.332897,"redis_calls":13,"redis_duration_s":0.0017569999999999999,"redis_read_bytes":12,"redis_write_bytes":1300,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":289,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000649,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":395,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000852,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":616,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216787,"duration_s":0.020862,"completed_at":"2026-09-13T10:48:04.864Z","load_balancing_strategy":"primary","db_duration_s":0.004741,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1624gitlab # [ 180.374103] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7da4d119099af8022911f696","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7da4d119099af8022911f696: start","job_status":"start","queue_duration_s":1.35462,"scheduling_latency_s":1.354633}1625gitlab # [ 180.419693] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7da4d119099af8022911f696","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7da4d119099af8022911f696: done: 0.011044 sec","job_status":"done","queue_duration_s":1.35462,"scheduling_latency_s":1.354633,"redis_calls":10,"redis_duration_s":0.0013549999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000842,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011044,"completed_at":"2026-09-13T10:48:04.876Z","load_balancing_strategy":"primary","db_duration_s":0.001029,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1626gitlab # [ 180.420746] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6e8b46a7dc425eb3c57edaba","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6e8b46a7dc425eb3c57edaba: start","job_status":"start","queue_duration_s":1.366953,"scheduling_latency_s":1.366966}1627gitlab # [ 180.428686] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6e8b46a7dc425eb3c57edaba","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6e8b46a7dc425eb3c57edaba: done: 0.011832 sec","job_status":"done","queue_duration_s":1.366953,"scheduling_latency_s":1.366966,"redis_calls":10,"redis_duration_s":0.001316,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000808,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011832,"completed_at":"2026-09-13T10:48:04.889Z","load_balancing_strategy":"primary","db_duration_s":0.001889,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1628gitlab # [ 180.477154] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5c9ac9dd75924b8077b871f7","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5c9ac9dd75924b8077b871f7: start","job_status":"start","queue_duration_s":1.379584,"scheduling_latency_s":1.379598}1629gitlab # [ 180.477807] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5c9ac9dd75924b8077b871f7","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5c9ac9dd75924b8077b871f7: done: 0.011317 sec","job_status":"done","queue_duration_s":1.379584,"scheduling_latency_s":1.379598,"redis_calls":10,"redis_duration_s":0.001534,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011317,"completed_at":"2026-09-13T10:48:04.901Z","load_balancing_strategy":"primary","db_duration_s":0.001499,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1630gitlab # [ 180.529774] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"279fbf76de1a7664538692b9","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-279fbf76de1a7664538692b9: start","job_status":"start","queue_duration_s":1.391957,"scheduling_latency_s":1.39197}1631gitlab # [ 180.530716] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"279fbf76de1a7664538692b9","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-279fbf76de1a7664538692b9: done: 0.017277 sec","job_status":"done","queue_duration_s":1.391957,"scheduling_latency_s":1.39197,"redis_calls":10,"redis_duration_s":0.001635,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.003,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017277,"completed_at":"2026-09-13T10:48:04.920Z","load_balancing_strategy":"primary","db_duration_s":0.008524,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1632gitlab # [ 180.549807] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f2dd1bcd69f35ffd391d9aca","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f2dd1bcd69f35ffd391d9aca: start","job_status":"start","queue_duration_s":1.410087,"scheduling_latency_s":1.4101}1633gitlab # [ 180.588635] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f2dd1bcd69f35ffd391d9aca","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f2dd1bcd69f35ffd391d9aca: done: 0.011533 sec","job_status":"done","queue_duration_s":1.410087,"scheduling_latency_s":1.4101,"redis_calls":10,"redis_duration_s":0.001339,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000782,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011533,"completed_at":"2026-09-13T10:48:04.932Z","load_balancing_strategy":"primary","db_duration_s":0.001973,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1634gitlab # [ 180.593590] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"42c2fa7c2c6a286374df0f4f","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-42c2fa7c2c6a286374df0f4f: start","job_status":"start","queue_duration_s":1.422444,"scheduling_latency_s":1.422457}1635gitlab # [ 180.604251] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"42c2fa7c2c6a286374df0f4f","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-42c2fa7c2c6a286374df0f4f: done: 0.010601 sec","job_status":"done","queue_duration_s":1.422444,"scheduling_latency_s":1.422457,"redis_calls":10,"redis_duration_s":0.001306,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000778,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010601,"completed_at":"2026-09-13T10:48:04.943Z","load_balancing_strategy":"primary","db_duration_s":0.000961,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1636gitlab # [ 180.661622] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"75dcb0ba8a44056f7036041a","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-75dcb0ba8a44056f7036041a: start","job_status":"start","queue_duration_s":1.43386,"scheduling_latency_s":1.433872}1637gitlab # [ 180.662250] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"75dcb0ba8a44056f7036041a","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-75dcb0ba8a44056f7036041a: done: 0.011348 sec","job_status":"done","queue_duration_s":1.43386,"scheduling_latency_s":1.433872,"redis_calls":10,"redis_duration_s":0.001375,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.0008,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011348,"completed_at":"2026-09-13T10:48:04.956Z","load_balancing_strategy":"primary","db_duration_s":0.001091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1638gitlab # [ 180.682619] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3647cf78723a5fcb223b94ab","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3647cf78723a5fcb223b94ab: start","job_status":"start","queue_duration_s":1.446099,"scheduling_latency_s":1.446111}1639gitlab # [ 180.723838] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3647cf78723a5fcb223b94ab","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3647cf78723a5fcb223b94ab: done: 0.015606 sec","job_status":"done","queue_duration_s":1.446099,"scheduling_latency_s":1.446111,"redis_calls":10,"redis_duration_s":0.001536,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015606,"completed_at":"2026-09-13T10:48:04.972Z","load_balancing_strategy":"primary","db_duration_s":0.004626,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1640gitlab # [ 180.726020] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5090394628c54242321462d2","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5090394628c54242321462d2: start","job_status":"start","queue_duration_s":1.462772,"scheduling_latency_s":1.46279}1641gitlab # [ 180.772702] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5090394628c54242321462d2","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5090394628c54242321462d2: done: 0.014863 sec","job_status":"done","queue_duration_s":1.462772,"scheduling_latency_s":1.46279,"redis_calls":10,"redis_duration_s":0.001619,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014863,"completed_at":"2026-09-13T10:48:04.988Z","load_balancing_strategy":"primary","db_duration_s":0.001156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1642gitlab # [ 180.773736] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:04.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"675e9dc9eaa1a50bb5c88d9d","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-675e9dc9eaa1a50bb5c88d9d: start","job_status":"start","queue_duration_s":1.479646,"scheduling_latency_s":1.47966}1643gitlab # [ 180.780636] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"675e9dc9eaa1a50bb5c88d9d","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-675e9dc9eaa1a50bb5c88d9d: done: 0.016605 sec","job_status":"done","queue_duration_s":1.479646,"scheduling_latency_s":1.47966,"redis_calls":10,"redis_duration_s":0.001408,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00084,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016605,"completed_at":"2026-09-13T10:48:05.007Z","load_balancing_strategy":"primary","db_duration_s":0.001288,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1644gitlab # [ 180.825060] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c671736356d4745e0e4fc1e4","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c671736356d4745e0e4fc1e4: start","job_status":"start","queue_duration_s":1.497202,"scheduling_latency_s":1.497217}1645gitlab # [ 180.825601] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c671736356d4745e0e4fc1e4","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c671736356d4745e0e4fc1e4: done: 0.014878 sec","job_status":"done","queue_duration_s":1.497202,"scheduling_latency_s":1.497217,"redis_calls":10,"redis_duration_s":0.001553,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014878,"completed_at":"2026-09-13T10:48:05.022Z","load_balancing_strategy":"primary","db_duration_s":0.004163,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1646gitlab # [ 180.858585] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"49176565fc512aab9d4a3b6c","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-49176565fc512aab9d4a3b6c: start","job_status":"start","queue_duration_s":1.512938,"scheduling_latency_s":1.512951}1647gitlab # [ 180.869548] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"49176565fc512aab9d4a3b6c","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-49176565fc512aab9d4a3b6c: done: 0.012215 sec","job_status":"done","queue_duration_s":1.512938,"scheduling_latency_s":1.512951,"redis_calls":10,"redis_duration_s":0.001596,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000736,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00086,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012215,"completed_at":"2026-09-13T10:48:05.035Z","load_balancing_strategy":"primary","db_duration_s":0.002037,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1648gitlab # [ 180.912782] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"75463d73163e8f7089fd4a71","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-75463d73163e8f7089fd4a71: start","job_status":"start","queue_duration_s":1.525984,"scheduling_latency_s":1.525998}1649gitlab # [ 180.913700] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"75463d73163e8f7089fd4a71","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-75463d73163e8f7089fd4a71: done: 0.011077 sec","job_status":"done","queue_duration_s":1.525984,"scheduling_latency_s":1.525998,"redis_calls":10,"redis_duration_s":0.001261,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000741,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011077,"completed_at":"2026-09-13T10:48:05.047Z","load_balancing_strategy":"primary","db_duration_s":0.001012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1650gitlab # [ 180.976757] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f2305dfed86f6d1a79b82e64","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f2305dfed86f6d1a79b82e64: start","job_status":"start","queue_duration_s":1.538172,"scheduling_latency_s":1.538199}1651gitlab # [ 180.977451] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f2305dfed86f6d1a79b82e64","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f2305dfed86f6d1a79b82e64: done: 0.017018 sec","job_status":"done","queue_duration_s":1.538172,"scheduling_latency_s":1.538199,"redis_calls":10,"redis_duration_s":0.001555,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017018,"completed_at":"2026-09-13T10:48:05.065Z","load_balancing_strategy":"primary","db_duration_s":0.002295,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1652gitlab # [ 180.990907] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b24dd926e13ede6d9c341d78","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b24dd926e13ede6d9c341d78: start","job_status":"start","queue_duration_s":1.556826,"scheduling_latency_s":1.556842}1653gitlab # [ 181.002524] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b24dd926e13ede6d9c341d78","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b24dd926e13ede6d9c341d78: done: 0.013413 sec","job_status":"done","queue_duration_s":1.556826,"scheduling_latency_s":1.556842,"redis_calls":10,"redis_duration_s":0.002414,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001603,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000811,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013413,"completed_at":"2026-09-13T10:48:05.081Z","load_balancing_strategy":"primary","db_duration_s":0.000989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654gitlab # [ 181.049464] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b46c7ca31afc4eb30acdcb61","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b46c7ca31afc4eb30acdcb61: start","job_status":"start","queue_duration_s":1.571092,"scheduling_latency_s":1.571105}1655gitlab # [ 181.050263] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b46c7ca31afc4eb30acdcb61","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b46c7ca31afc4eb30acdcb61: done: 0.011125 sec","job_status":"done","queue_duration_s":1.571092,"scheduling_latency_s":1.571105,"redis_calls":10,"redis_duration_s":0.0012439999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000737,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011125,"completed_at":"2026-09-13T10:48:05.093Z","load_balancing_strategy":"primary","db_duration_s":0.000988,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1656gitlab # [ 181.109895] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6ad85b68a8445e81af863617","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6ad85b68a8445e81af863617: start","job_status":"start","queue_duration_s":1.583117,"scheduling_latency_s":1.58313}1657gitlab # [ 181.110712] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6ad85b68a8445e81af863617","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6ad85b68a8445e81af863617: done: 0.012926 sec","job_status":"done","queue_duration_s":1.583117,"scheduling_latency_s":1.58313,"redis_calls":10,"redis_duration_s":0.001421,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000825,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012926,"completed_at":"2026-09-13T10:48:05.106Z","load_balancing_strategy":"primary","db_duration_s":0.001454,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1658gitlab # [ 181.124556] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f245a42843c7f1be323bac71","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f245a42843c7f1be323bac71: start","job_status":"start","queue_duration_s":1.597806,"scheduling_latency_s":1.597824}1659gitlab # [ 181.135418] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f245a42843c7f1be323bac71","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f245a42843c7f1be323bac71: done: 0.012937 sec","job_status":"done","queue_duration_s":1.597806,"scheduling_latency_s":1.597824,"redis_calls":10,"redis_duration_s":0.001628,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000641,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012937,"completed_at":"2026-09-13T10:48:05.121Z","load_balancing_strategy":"primary","db_duration_s":0.001114,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1660gitlab # [ 181.169538] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b006d135b421d90c6224b301","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b006d135b421d90c6224b301: start","job_status":"start","queue_duration_s":1.611624,"scheduling_latency_s":1.611639}1661gitlab # [ 181.180324] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b006d135b421d90c6224b301","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b006d135b421d90c6224b301: done: 0.017296 sec","job_status":"done","queue_duration_s":1.611624,"scheduling_latency_s":1.611639,"redis_calls":10,"redis_duration_s":0.001862,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000997,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000865,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017296,"completed_at":"2026-09-13T10:48:05.139Z","load_balancing_strategy":"primary","db_duration_s":0.006242,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1662gitlab # [ 181.227979] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"08908a3b6710fd43ec01d706","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-08908a3b6710fd43ec01d706: start","job_status":"start","queue_duration_s":1.629809,"scheduling_latency_s":1.629824}1663gitlab # [ 181.228766] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"08908a3b6710fd43ec01d706","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-08908a3b6710fd43ec01d706: done: 0.013992 sec","job_status":"done","queue_duration_s":1.629809,"scheduling_latency_s":1.629824,"redis_calls":10,"redis_duration_s":0.00371,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002791,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013992,"completed_at":"2026-09-13T10:48:05.154Z","load_balancing_strategy":"primary","db_duration_s":0.000934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664gitlab # [ 181.278337] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4f54f2aa1a13e480140c0e3b","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4f54f2aa1a13e480140c0e3b: start","job_status":"start","queue_duration_s":1.645434,"scheduling_latency_s":1.645448}1665gitlab # [ 181.279048] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4f54f2aa1a13e480140c0e3b","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4f54f2aa1a13e480140c0e3b: done: 0.011789 sec","job_status":"done","queue_duration_s":1.645434,"scheduling_latency_s":1.645448,"redis_calls":10,"redis_duration_s":0.001316,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000777,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011789,"completed_at":"2026-09-13T10:48:05.168Z","load_balancing_strategy":"primary","db_duration_s":0.000903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1666gitlab # [ 181.303417] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fafee693337004e3db2df1e3","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fafee693337004e3db2df1e3: start","job_status":"start","queue_duration_s":1.658064,"scheduling_latency_s":1.658076}1667gitlab # [ 181.314201] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fafee693337004e3db2df1e3","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fafee693337004e3db2df1e3: done: 0.010596 sec","job_status":"done","queue_duration_s":1.658064,"scheduling_latency_s":1.658076,"redis_calls":10,"redis_duration_s":0.0013059999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000755,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010596,"completed_at":"2026-09-13T10:48:05.179Z","load_balancing_strategy":"primary","db_duration_s":0.000901,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1668gitlab # [ 181.357716] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e5f12b29eac8887f6fdc1aa7","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e5f12b29eac8887f6fdc1aa7: start","job_status":"start","queue_duration_s":1.669641,"scheduling_latency_s":1.669655}1669gitlab # [ 181.358564] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e5f12b29eac8887f6fdc1aa7","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e5f12b29eac8887f6fdc1aa7: done: 0.01072 sec","job_status":"done","queue_duration_s":1.669641,"scheduling_latency_s":1.669655,"redis_calls":10,"redis_duration_s":0.001361,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000821,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01072,"completed_at":"2026-09-13T10:48:05.191Z","load_balancing_strategy":"primary","db_duration_s":0.000888,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670gitlab # [ 181.411492] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7f888c1c9e949e774a1811a0","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7f888c1c9e949e774a1811a0: start","job_status":"start","queue_duration_s":1.681187,"scheduling_latency_s":1.681199}1671gitlab # [ 181.412311] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7f888c1c9e949e774a1811a0","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7f888c1c9e949e774a1811a0: done: 0.01059 sec","job_status":"done","queue_duration_s":1.681187,"scheduling_latency_s":1.681199,"redis_calls":10,"redis_duration_s":0.001302,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000784,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01059,"completed_at":"2026-09-13T10:48:05.202Z","load_balancing_strategy":"primary","db_duration_s":0.000893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1672gitlab # [ 181.452266] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6f397eaae67b4533491aeb99","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6f397eaae67b4533491aeb99: start","job_status":"start","queue_duration_s":1.69258,"scheduling_latency_s":1.692593}1673gitlab # [ 181.452998] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6f397eaae67b4533491aeb99","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6f397eaae67b4533491aeb99: done: 0.011334 sec","job_status":"done","queue_duration_s":1.69258,"scheduling_latency_s":1.692593,"redis_calls":10,"redis_duration_s":0.001366,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000862,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011334,"completed_at":"2026-09-13T10:48:05.214Z","load_balancing_strategy":"primary","db_duration_s":0.000879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1674gitlab # [ 181.491513] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6e1718b22250d5acf3319af6","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6e1718b22250d5acf3319af6: start","job_status":"start","queue_duration_s":1.704787,"scheduling_latency_s":1.704801}1675gitlab # [ 181.492240] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6e1718b22250d5acf3319af6","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6e1718b22250d5acf3319af6: done: 0.010866 sec","job_status":"done","queue_duration_s":1.704787,"scheduling_latency_s":1.704801,"redis_calls":10,"redis_duration_s":0.001366,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000859,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010866,"completed_at":"2026-09-13T10:48:05.226Z","load_balancing_strategy":"primary","db_duration_s":0.000945,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1676gitlab # [ 181.545752] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ecba947547ebfccb9f367eef","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ecba947547ebfccb9f367eef: start","job_status":"start","queue_duration_s":1.716482,"scheduling_latency_s":1.716495}1677gitlab # [ 181.546682] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ecba947547ebfccb9f367eef","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ecba947547ebfccb9f367eef: done: 0.012037 sec","job_status":"done","queue_duration_s":1.716482,"scheduling_latency_s":1.716495,"redis_calls":10,"redis_duration_s":0.0018349999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001331,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012037,"completed_at":"2026-09-13T10:48:05.239Z","load_balancing_strategy":"primary","db_duration_s":0.000886,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1678gitlab # [ 181.568949] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"338b60da558546b6136482cc","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-338b60da558546b6136482cc: start","job_status":"start","queue_duration_s":1.729343,"scheduling_latency_s":1.729356}1679gitlab # [ 181.579749] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"338b60da558546b6136482cc","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-338b60da558546b6136482cc: done: 0.010792 sec","job_status":"done","queue_duration_s":1.729343,"scheduling_latency_s":1.729356,"redis_calls":10,"redis_duration_s":0.001343,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000815,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010792,"completed_at":"2026-09-13T10:48:05.250Z","load_balancing_strategy":"primary","db_duration_s":0.00091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1680gitlab # [ 181.622776] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"609d13c061ad92220143418c","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-609d13c061ad92220143418c: start","job_status":"start","queue_duration_s":1.741009,"scheduling_latency_s":1.741022}1681gitlab # [ 181.623556] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"609d13c061ad92220143418c","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-609d13c061ad92220143418c: done: 0.010873 sec","job_status":"done","queue_duration_s":1.741009,"scheduling_latency_s":1.741022,"redis_calls":10,"redis_duration_s":0.0013340000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000788,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010873,"completed_at":"2026-09-13T10:48:05.262Z","load_balancing_strategy":"primary","db_duration_s":0.001081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1682gitlab # [ 181.666030] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d98509e58b96fa5b29258d6c","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d98509e58b96fa5b29258d6c: start","job_status":"start","queue_duration_s":1.752686,"scheduling_latency_s":1.752699}1683gitlab # [ 181.703641] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d98509e58b96fa5b29258d6c","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d98509e58b96fa5b29258d6c: done: 0.010758 sec","job_status":"done","queue_duration_s":1.752686,"scheduling_latency_s":1.752699,"redis_calls":10,"redis_duration_s":0.0012590000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000737,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010758,"completed_at":"2026-09-13T10:48:05.274Z","load_balancing_strategy":"primary","db_duration_s":0.000904,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1684gitlab # [ 181.704622] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"04589972c1f1935260357c6a","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-04589972c1f1935260357c6a: start","job_status":"start","queue_duration_s":1.764251,"scheduling_latency_s":1.764263}1685gitlab # [ 181.710911] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.285Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"04589972c1f1935260357c6a","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-04589972c1f1935260357c6a: done: 0.010809 sec","job_status":"done","queue_duration_s":1.764251,"scheduling_latency_s":1.764263,"redis_calls":10,"redis_duration_s":0.001284,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000762,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010809,"completed_at":"2026-09-13T10:48:05.285Z","load_balancing_strategy":"primary","db_duration_s":0.000888,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1686gitlab # [ 181.760076] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5421b0f6565df7e8b72da8d1","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5421b0f6565df7e8b72da8d1: start","job_status":"start","queue_duration_s":1.775873,"scheduling_latency_s":1.775886}1687gitlab # [ 181.760976] runuser[2191]: pam_unix(runuser:session): session closed for user gitlab1688gitlab # [ 181.761835] systemd[1]: Stopping gitlab-sidekiq.service...1689gitlab # [ 181.762813] setup-gitlab-start[2172]: + systemctl restart gitlab-sidekiq.service1690gitlab # [ 181.763468] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5421b0f6565df7e8b72da8d1","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5421b0f6565df7e8b72da8d1: done: 0.010973 sec","job_status":"done","queue_duration_s":1.775873,"scheduling_latency_s":1.775886,"redis_calls":10,"redis_duration_s":0.001495,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010973,"completed_at":"2026-09-13T10:48:05.297Z","load_balancing_strategy":"primary","db_duration_s":0.000913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1691gitlab # [ 181.792275] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6584826ca531eb21940473a9","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6584826ca531eb21940473a9: start","job_status":"start","queue_duration_s":1.787642,"scheduling_latency_s":1.787655}1692gitlab # [ 181.803255] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6584826ca531eb21940473a9","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6584826ca531eb21940473a9: done: 0.010638 sec","job_status":"done","queue_duration_s":1.787642,"scheduling_latency_s":1.787655,"redis_calls":10,"redis_duration_s":0.001281,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000781,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010638,"completed_at":"2026-09-13T10:48:05.309Z","load_balancing_strategy":"primary","db_duration_s":0.000879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1693gitlab # [ 181.863888] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a2594827242e6a3dda4f0388","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a2594827242e6a3dda4f0388: start","job_status":"start","queue_duration_s":1.799253,"scheduling_latency_s":1.799266}1694gitlab # [ 181.864714] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a2594827242e6a3dda4f0388","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a2594827242e6a3dda4f0388: done: 0.010762 sec","job_status":"done","queue_duration_s":1.799253,"scheduling_latency_s":1.799266,"redis_calls":10,"redis_duration_s":0.001581,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010762,"completed_at":"2026-09-13T10:48:05.320Z","load_balancing_strategy":"primary","db_duration_s":0.000879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1695gitlab # [ 181.907664] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0fe91af8a2c5c2fa806863ed","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0fe91af8a2c5c2fa806863ed: start","job_status":"start","queue_duration_s":1.810834,"scheduling_latency_s":1.810847}1696gitlab # [ 181.908518] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0fe91af8a2c5c2fa806863ed","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0fe91af8a2c5c2fa806863ed: done: 0.012778 sec","job_status":"done","queue_duration_s":1.810834,"scheduling_latency_s":1.810847,"redis_calls":10,"redis_duration_s":0.001534,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000628,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012778,"completed_at":"2026-09-13T10:48:05.334Z","load_balancing_strategy":"primary","db_duration_s":0.000883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1697gitlab # [ 181.955934] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e4cbe1e10748b5e42aa4d7b2","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e4cbe1e10748b5e42aa4d7b2: start","job_status":"start","queue_duration_s":1.824705,"scheduling_latency_s":1.824746}1698gitlab # [ 181.956604] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e4cbe1e10748b5e42aa4d7b2","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e4cbe1e10748b5e42aa4d7b2: done: 0.012521 sec","job_status":"done","queue_duration_s":1.824705,"scheduling_latency_s":1.824746,"redis_calls":10,"redis_duration_s":0.001405,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000857,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012521,"completed_at":"2026-09-13T10:48:05.348Z","load_balancing_strategy":"primary","db_duration_s":0.001377,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1699gitlab # [ 182.004957] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cbd84a51d8f1e5300d08608a","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cbd84a51d8f1e5300d08608a: start","job_status":"start","queue_duration_s":1.838228,"scheduling_latency_s":1.838241}1700gitlab # [ 182.005641] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cbd84a51d8f1e5300d08608a","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cbd84a51d8f1e5300d08608a: done: 0.015988 sec","job_status":"done","queue_duration_s":1.838228,"scheduling_latency_s":1.838241,"redis_calls":10,"redis_duration_s":0.001375,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000813,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015988,"completed_at":"2026-09-13T10:48:05.365Z","load_balancing_strategy":"primary","db_duration_s":0.006148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1701gitlab # [ 182.047787] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"06607eb7ca7d79744a151e3b","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-06607eb7ca7d79744a151e3b: start","job_status":"start","queue_duration_s":1.855071,"scheduling_latency_s":1.855084}1702gitlab # [ 182.048663] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"06607eb7ca7d79744a151e3b","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-06607eb7ca7d79744a151e3b: done: 0.010438 sec","job_status":"done","queue_duration_s":1.855071,"scheduling_latency_s":1.855084,"redis_calls":10,"redis_duration_s":0.001279,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00074,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010438,"completed_at":"2026-09-13T10:48:05.376Z","load_balancing_strategy":"primary","db_duration_s":0.000992,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1703gitlab # [ 182.056069] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0a020967584c8c10019ce7bd","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0a020967584c8c10019ce7bd: start","job_status":"start","queue_duration_s":1.86631,"scheduling_latency_s":1.866323}1704gitlab # [ 182.100741] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0a020967584c8c10019ce7bd","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0a020967584c8c10019ce7bd: done: 0.010471 sec","job_status":"done","queue_duration_s":1.86631,"scheduling_latency_s":1.866323,"redis_calls":10,"redis_duration_s":0.0012850000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000726,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010471,"completed_at":"2026-09-13T10:48:05.387Z","load_balancing_strategy":"primary","db_duration_s":0.000957,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1705gitlab # [ 182.101864] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f684867c24ec84d365c54312","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f684867c24ec84d365c54312: start","job_status":"start","queue_duration_s":1.87776,"scheduling_latency_s":1.877774}1706gitlab # [ 182.110728] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f684867c24ec84d365c54312","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f684867c24ec84d365c54312: done: 0.010858 sec","job_status":"done","queue_duration_s":1.87776,"scheduling_latency_s":1.877774,"redis_calls":11,"redis_duration_s":0.0013490000000000002,"redis_read_bytes":136,"redis_write_bytes":991,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000119,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010858,"completed_at":"2026-09-13T10:48:05.399Z","load_balancing_strategy":"primary","db_duration_s":0.000941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1707gitlab # [ 182.164155] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"be7cc61cd6c3fe248e61b11e","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-be7cc61cd6c3fe248e61b11e: start","job_status":"start","queue_duration_s":1.889425,"scheduling_latency_s":1.889438}1708gitlab # [ 182.164885] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"be7cc61cd6c3fe248e61b11e","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-be7cc61cd6c3fe248e61b11e: done: 0.010387 sec","job_status":"done","queue_duration_s":1.889425,"scheduling_latency_s":1.889438,"redis_calls":10,"redis_duration_s":0.00131,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000748,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010387,"completed_at":"2026-09-13T10:48:05.410Z","load_balancing_strategy":"primary","db_duration_s":0.000929,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1709gitlab # [ 182.202935] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d1234eb4939b6165ccabb682","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d1234eb4939b6165ccabb682: start","job_status":"start","queue_duration_s":1.900608,"scheduling_latency_s":1.900621}1710gitlab # [ 182.203718] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d1234eb4939b6165ccabb682","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d1234eb4939b6165ccabb682: done: 0.010774 sec","job_status":"done","queue_duration_s":1.900608,"scheduling_latency_s":1.900621,"redis_calls":10,"redis_duration_s":0.00141,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00074,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010774,"completed_at":"2026-09-13T10:48:05.422Z","load_balancing_strategy":"primary","db_duration_s":0.00103,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1711gitlab # [ 182.246105] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"08baa35a80cc51695cbc2b96","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-08baa35a80cc51695cbc2b96: start","job_status":"start","queue_duration_s":1.912238,"scheduling_latency_s":1.912251}1712gitlab # [ 182.246611] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"08baa35a80cc51695cbc2b96","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-08baa35a80cc51695cbc2b96: done: 0.010645 sec","job_status":"done","queue_duration_s":1.912238,"scheduling_latency_s":1.912251,"redis_calls":10,"redis_duration_s":0.0013080000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000789,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010645,"completed_at":"2026-09-13T10:48:05.433Z","load_balancing_strategy":"primary","db_duration_s":0.000909,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1713gitlab # [ 182.287229] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3e8ef0a65d87d5b06058083f","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3e8ef0a65d87d5b06058083f: start","job_status":"start","queue_duration_s":1.923708,"scheduling_latency_s":1.923745}1714gitlab # [ 182.287963] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.444Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3e8ef0a65d87d5b06058083f","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3e8ef0a65d87d5b06058083f: done: 0.010221 sec","job_status":"done","queue_duration_s":1.923708,"scheduling_latency_s":1.923745,"redis_calls":10,"redis_duration_s":0.001291,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000725,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010221,"completed_at":"2026-09-13T10:48:05.444Z","load_balancing_strategy":"primary","db_duration_s":0.000926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1715gitlab # [ 182.330066] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c3cdf02fe6107f472d0077f1","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c3cdf02fe6107f472d0077f1: start","job_status":"start","queue_duration_s":1.934841,"scheduling_latency_s":1.934854}1716gitlab # [ 182.330835] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c3cdf02fe6107f472d0077f1","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c3cdf02fe6107f472d0077f1: done: 0.015293 sec","job_status":"done","queue_duration_s":1.934841,"scheduling_latency_s":1.934854,"redis_calls":10,"redis_duration_s":0.001303,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000754,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015293,"completed_at":"2026-09-13T10:48:05.460Z","load_balancing_strategy":"primary","db_duration_s":0.005677,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1717gitlab # [ 182.374106] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3a343e2b36d9a0f604bd913c","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3a343e2b36d9a0f604bd913c: start","job_status":"start","queue_duration_s":1.950985,"scheduling_latency_s":1.950998}1718gitlab # [ 182.374783] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3a343e2b36d9a0f604bd913c","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3a343e2b36d9a0f604bd913c: done: 0.010469 sec","job_status":"done","queue_duration_s":1.950985,"scheduling_latency_s":1.950998,"redis_calls":10,"redis_duration_s":0.001294,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000769,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010469,"completed_at":"2026-09-13T10:48:05.472Z","load_balancing_strategy":"primary","db_duration_s":0.00099,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1719gitlab # [ 182.414606] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6b694b1eea00258bb913aef9","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6b694b1eea00258bb913aef9: start","job_status":"start","queue_duration_s":1.962295,"scheduling_latency_s":1.962308}1720gitlab # [ 182.417024] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6b694b1eea00258bb913aef9","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6b694b1eea00258bb913aef9: done: 0.010306 sec","job_status":"done","queue_duration_s":1.962295,"scheduling_latency_s":1.962308,"redis_calls":10,"redis_duration_s":0.00132,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000765,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010306,"completed_at":"2026-09-13T10:48:05.483Z","load_balancing_strategy":"primary","db_duration_s":0.000958,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1721gitlab # [ 182.461129] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8c89d45df3726970f8fe3f78","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8c89d45df3726970f8fe3f78: start","job_status":"start","queue_duration_s":1.973606,"scheduling_latency_s":1.973619}1722gitlab # [ 182.461786] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8c89d45df3726970f8fe3f78","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8c89d45df3726970f8fe3f78: done: 0.010452 sec","job_status":"done","queue_duration_s":1.973606,"scheduling_latency_s":1.973619,"redis_calls":10,"redis_duration_s":0.0013410000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000585,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000756,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010452,"completed_at":"2026-09-13T10:48:05.494Z","load_balancing_strategy":"primary","db_duration_s":0.000916,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1723gitlab # [ 182.515831] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0776a3e2636a71aa2c23d8c8","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0776a3e2636a71aa2c23d8c8: start","job_status":"start","queue_duration_s":1.984892,"scheduling_latency_s":1.984905}1724gitlab # [ 182.516819] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0776a3e2636a71aa2c23d8c8","created_at":"2026-09-13T10:48:03.463Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-8fb02bcea6a94fdf","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"4f5583cb1e4dcd7c775855224985ab51","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:03.510Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0776a3e2636a71aa2c23d8c8: done: 0.014129 sec","job_status":"done","queue_duration_s":1.984892,"scheduling_latency_s":1.984905,"redis_calls":10,"redis_duration_s":0.001333,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000788,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014129,"completed_at":"2026-09-13T10:48:05.509Z","load_balancing_strategy":"primary","db_duration_s":0.005958,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1725gitlab # [ 182.556914] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.510Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ff6ed65e938a22c4b02ac913","created_at":"2026-09-13T10:48:04.281Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-cb2be3f67579458e","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2de0b1db4962d8cb0aa60569c24dbaf3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:04.287Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ff6ed65e938a22c4b02ac913: start","job_status":"start","queue_duration_s":1.223243,"scheduling_latency_s":1.223256}1726gitlab # [ 182.557687] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.517Z","message":"No existing merge request to be cleaned up."}1727gitlab # [ 182.558491] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.522Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ff6ed65e938a22c4b02ac913","created_at":"2026-09-13T10:48:04.281Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-cb2be3f67579458e","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2de0b1db4962d8cb0aa60569c24dbaf3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:04.287Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ff6ed65e938a22c4b02ac913: done: 0.011392 sec","job_status":"done","queue_duration_s":1.223243,"scheduling_latency_s":1.223256,"redis_calls":10,"redis_duration_s":0.001544,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011392,"completed_at":"2026-09-13T10:48:05.522Z","load_balancing_strategy":"primary","db_duration_s":0.001313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1728gitlab # [ 182.606331] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.523Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8d6dc8a56a0bedc7b7181280","created_at":"2026-09-13T10:48:04.281Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-cb2be3f67579458e","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2de0b1db4962d8cb0aa60569c24dbaf3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:04.287Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8d6dc8a56a0bedc7b7181280: start","job_status":"start","queue_duration_s":1.235494,"scheduling_latency_s":1.235507}1729gitlab # [ 182.607059] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.529Z","message":"No existing merge request to be cleaned up."}1730gitlab # [ 182.607918] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.533Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8d6dc8a56a0bedc7b7181280","created_at":"2026-09-13T10:48:04.281Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-cb2be3f67579458e","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2de0b1db4962d8cb0aa60569c24dbaf3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:04.287Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8d6dc8a56a0bedc7b7181280: done: 0.010625 sec","job_status":"done","queue_duration_s":1.235494,"scheduling_latency_s":1.235507,"redis_calls":10,"redis_duration_s":0.001487,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000855,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010625,"completed_at":"2026-09-13T10:48:05.533Z","load_balancing_strategy":"primary","db_duration_s":0.001157,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1731gitlab # [ 182.650879] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.534Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e798167e5eb5a0dd92520fb1","created_at":"2026-09-13T10:48:04.281Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-cb2be3f67579458e","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2de0b1db4962d8cb0aa60569c24dbaf3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:04.287Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e798167e5eb5a0dd92520fb1: start","job_status":"start","queue_duration_s":1.247004,"scheduling_latency_s":1.247017}1732gitlab # [ 182.651700] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.540Z","message":"No existing merge request to be cleaned up."}1733gitlab # [ 182.652509] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.545Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e798167e5eb5a0dd92520fb1","created_at":"2026-09-13T10:48:04.281Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-cb2be3f67579458e","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2de0b1db4962d8cb0aa60569c24dbaf3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:04.287Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e798167e5eb5a0dd92520fb1: done: 0.010615 sec","job_status":"done","queue_duration_s":1.247004,"scheduling_latency_s":1.247017,"redis_calls":10,"redis_duration_s":0.00132,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000818,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010615,"completed_at":"2026-09-13T10:48:05.545Z","load_balancing_strategy":"primary","db_duration_s":0.001011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1734gitlab # [ 182.674894] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.546Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4440fa994ef5d47d6d950e43","created_at":"2026-09-13T10:48:04.281Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-cb2be3f67579458e","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2de0b1db4962d8cb0aa60569c24dbaf3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:04.287Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4440fa994ef5d47d6d950e43: start","job_status":"start","queue_duration_s":1.258455,"scheduling_latency_s":1.258468}1735gitlab # [ 182.686184] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.551Z","message":"No existing merge request to be cleaned up."}1736gitlab # [ 182.687775] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:05.556Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4440fa994ef5d47d6d950e43","created_at":"2026-09-13T10:48:04.281Z","trace_propagation_headers":{"sentry-trace":"8ea29db4e48c4436b20b9dbb2ba1ca78-cb2be3f67579458e","baggage":"sentry-trace_id=8ea29db4e48c4436b20b9dbb2ba1ca78,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2de0b1db4962d8cb0aa60569c24dbaf3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:04.287Z","job_size_bytes":2,"pid":1600,"sidekiq_tid":"madw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4440fa994ef5d47d6d950e43: done: 0.010167 sec","job_status":"done","queue_duration_s":1.258455,"scheduling_latency_s":1.258468,"redis_calls":10,"redis_duration_s":0.001251,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000748,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010167,"completed_at":"2026-09-13T10:48:05.556Z","load_balancing_strategy":"primary","db_duration_s":0.000905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1737gitlab # [ 182.730959] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:08.170Z","message":"Shutting down"}1738gitlab # [ 182.731715] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:08.170Z","message":"Scheduler exiting..."}1739gitlab # [ 182.732173] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:08.170Z","message":"Terminating quiet threads for default capsule"}1740gitlab # [ 182.732627] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:08.171Z","message":"Scheduler exiting..."}1741gitlab # [ 182.733172] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:08.671Z","message":"Pausing to allow jobs to finish..."}1742gitlab # [ 184.244239] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:10.675Z","message":"Bye!"}1743gitlab # [ 184.266670] sidekiq-cluster[1600]: {"severity":"INFO","time":"2026-09-13T10:48:10.698Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1600,"worker_id":"sidekiq_0","memwd_rss_bytes":943747072,"retry":0}1744gitlab # [ 185.343590] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1745gitlab # [ 185.346122] systemd[1]: Stopped gitlab-sidekiq.service.1746gitlab # [ 185.347962] systemd[1]: gitlab-sidekiq.service: Consumed 56.841s CPU time over 1min 54.042s wall clock time, 936M memory peak, 4.4M read from disk.1747gitlab # [ 185.352572] systemd[1]: Started gitlab-sidekiq.service.1748gitlab # [ 185.355131] setup-gitlab-start[2172]: + mkdir -p /var/lib/secrets1749gitlab # [ 185.357548] setup-gitlab-start[2172]: + echo nixbot-test-token-of-20-chars1750gitlab # [ 185.359793] setup-gitlab-start[2172]: + chmod 644 /var/lib/secrets/gitlab-token1751gitlab # [ 185.362232] setup-gitlab-start[2172]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1752gitlab # [ 185.547745] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:11 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 1571753gitlab # [ 185.967910] gitaly[889]: time="2026-09-13T10:48:12.399Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T10:48:22.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.399" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1754gitlab # [ 185.989984] gitaly[889]: time="2026-09-13T10:48:12.399Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T10:48:22.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.399" grpc.time_ms=0.241 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1755gitlab # [ 186.053473] gitaly[889]: time="2026-09-13T10:48:12.485Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T10:48:22.095" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.485" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1756gitlab # [ 186.075400] gitaly[889]: time="2026-09-13T10:48:12.486Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T10:48:22.095" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.485" grpc.time_ms=0.331 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1757gitlab # [ 186.160788] gitaly[889]: time="2026-09-13T10:48:12.593Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP diskcache=ce1f70e8-aee8-4c3f-a3a4-d8e078e1570f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-13T10:48:22.146" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.537" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1758gitlab # [ 186.184500] gitaly[889]: time="2026-09-13T10:48:12.593Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1586 command.oublock=32 command.real_time_ms=27 command.spawn_token_fork_ms=1 command.system_time_ms=16 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-13T10:48:22.146" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.537" grpc.time_ms=55.748 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1759gitlab # [ 186.185587] gitaly[889]: time="2026-09-13T10:48:12.607Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T10:48:22.216" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.607" pid=889 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1760gitlab # [ 186.187376] gitaly[889]: time="2026-09-13T10:48:12.608Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T10:48:22.216" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.607" grpc.time_ms=1.11 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1761gitlab # [ 186.191131] gitaly[889]: time="2026-09-13T10:48:12.623Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T10:48:22.222" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.613" grpc.time_ms=9.98 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762gitlab # [ 186.235466] gitaly[889]: time="2026-09-13T10:48:12.667Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T10:48:22.277" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.667" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763gitlab # [ 186.236284] gitaly[889]: time="2026-09-13T10:48:12.667Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T10:48:22.277" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.667" grpc.time_ms=0.221 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764gitlab # [ 186.273106] gitaly[889]: time="2026-09-13T10:48:12.705Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP diskcache=d4429b0d-3c1a-4f0b-bdc0-b26ebcad866c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-13T10:48:22.280" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.671" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765gitlab # [ 186.282491] gitaly[889]: time="2026-09-13T10:48:12.706Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1584 command.oublock=32 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-13T10:48:22.280" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.671" grpc.time_ms=35.118 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 186.283168] gitaly[889]: time="2026-09-13T10:48:12.711Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T10:48:22.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.711" pid=889 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1767gitlab # [ 186.283749] gitaly[889]: time="2026-09-13T10:48:12.712Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T10:48:22.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.711" grpc.time_ms=0.817 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 186.323954] gitaly[889]: time="2026-09-13T10:48:12.756Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T10:48:22.046" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.746" grpc.time_ms=9.906 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 186.366355] gitaly[889]: time="2026-09-13T10:48:12.798Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T10:48:22.097" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.798" grpc.time_ms=0.219 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 186.380146] gitaly[889]: time="2026-09-13T10:48:12.811Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-13T10:48:22.108" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:12.809" grpc.time_ms=0.358 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 186.823737] gitaly[889]: time="2026-09-13T10:48:13.256Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63FENNJA2CRWGJNSVJMHP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T10:48:23.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:13.247" grpc.time_ms=8.736 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772gitlab # [ 187.101392] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:13 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 15421773gitlab # [ 187.107860] setup-gitlab-start[2433]: {"id":1,"message":null,"error":null}1774gitlab # [ 188.408446] sidekiq-cluster[2421]: {"severity":"INFO","time":"2026-09-13T10:48:14.823Z","message":"Starting cluster with 1 processes"}1775gitlab # [ 192.249419] gitaly[889]: time="2026-09-13T10:48:18.681Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63NW7WB31ZWSKS34EPE72 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T10:48:28.279" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:18.670" grpc.time_ms=10.61 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1776gitlab # [ 192.320142] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:18 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 1841777gitlab # [ 192.325590] setup-gitlab-start[2172]: + mkdir -p /tmp/test-flake1778gitlab # [ 192.327983] setup-gitlab-start[2172]: + cd /tmp/test-flake1779gitlab # [ 192.329464] setup-gitlab-start[2172]: + git init -b master1780gitlab # [ 192.346931] setup-gitlab-start[2503]: Initialized empty Git repository in /tmp/test-flake/.git/1781gitlab # [ 192.348394] setup-gitlab-start[2172]: + git config user.name test1782gitlab # [ 192.355958] setup-gitlab-start[2172]: + git config user.email test@example.com1783gitlab # [ 192.360891] setup-gitlab-start[2172]: + cat1784gitlab # [ 192.362724] setup-gitlab-start[2172]: + git add flake.nix1785gitlab # [ 192.365164] setup-gitlab-start[2172]: + git commit -m 'initial commit'1786gitlab # [ 192.385479] setup-gitlab-start[2508]: [master (root-commit) 2011f83] initial commit1787gitlab # [ 192.387818] setup-gitlab-start[2508]: 1 file changed, 10 insertions(+)1788gitlab # [ 192.389176] setup-gitlab-start[2508]: create mode 100644 flake.nix1789gitlab # [ 192.390417] setup-gitlab-start[2172]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1790gitlab # [ 192.392381] setup-gitlab-start[2172]: + git push -u origin master1791gitlab # [ 192.571874] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:19 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 1541792gitlab # [ 192.656837] gitaly[889]: time="2026-09-13T10:48:19.089Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2D63P9XKVG2SCSKB2FAHXFN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:19.081" grpc.time_ms=7.088 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1793gitlab # [ 192.686196] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:19 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1121794gitlab # [ 192.879841] gitaly[889]: time="2026-09-13T10:48:19.312Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T10:48:29.062" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:19.302" grpc.time_ms=9.021 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1795gitlab # [ 192.939200] gitaly[889]: time="2026-09-13T10:48:19.371Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-13T10:48:49.062" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-13T10:48:19.362" grpc.time_ms=8.411 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1796gitlab # [ 192.954060] gitaly[889]: time="2026-09-13T10:48:19.386Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW duration_ms=129ns method=POST pid=889 status=200 url="http://unix/api/v4/internal/allowed"1797gitlab # [ 192.993922] gitaly[889]: time="2026-09-13T10:48:19.426Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW duration_ms=39ns method=POST pid=889 status=200 url="http://unix/api/v4/internal/pre_receive"1798gitlab # [ 192.995672] gitaly[889]: time="2026-09-13T10:48:19.428Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5307 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:48:19.255" grpc.time_ms=172.556 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1799gitlab # [ 193.053523] gitaly[889]: time="2026-09-13T10:48:19.485Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4777 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:48:19.485" grpc.time_ms=0.713 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1800gitlab # [ 193.101505] gitaly[889]: time="2026-09-13T10:48:19.533Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4776 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:48:19.531" grpc.time_ms=1.528 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1801gitlab # [ 193.138111] gitaly[889]: time="2026-09-13T10:48:19.569Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:48:19.569" grpc.time_ms=0.272 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1802gitlab # [ 193.216709] gitaly[889]: time="2026-09-13T10:48:19.649Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T10:48:29.248" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:19.638" grpc.time_ms=10.524 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 193.267810] gitaly[889]: time="2026-09-13T10:48:19.699Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1563 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-13T10:48:29.289" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:48:19.679" grpc.time_ms=19.586 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 193.293404] gitaly[889]: time="2026-09-13T10:48:19.725Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW duration_ms=123ns method=POST pid=889 status=200 url="http://unix/api/v4/internal/post_receive"1805gitlab # [ 193.295106] gitaly[889]: time="2026-09-13T10:48:19.726Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4801 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:48:19.601" grpc.time_ms=124.446 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1806gitlab # [ 193.316269] gitaly[889]: time="2026-09-13T10:48:19.748Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW diskcache=5a61d764-d775-444f-8e9f-edcc89111bf5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:19.183" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1807gitlab # [ 193.317483] gitaly[889]: time="2026-09-13T10:48:19.748Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=208 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=901120 command.minflt=13600 command.oublock=32 command.real_time_ms=555 command.spawn_token_fork_ms=0 command.system_time_ms=134 command.user_time_ms=74 component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:19.183" grpc.time_ms=565.735 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1808gitlab # [ 193.338455] gitlab-workhorse[823]: time="2026-09-13T10:48:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521809gitlab # [ 193.339589] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:19 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6381810gitlab # [ 193.343630] setup-gitlab-start[2512]: To http://gitlab/root/test-flake.git1811gitlab # [ 193.344766] setup-gitlab-start[2512]: * [new branch] master -> master1812gitlab # [ 193.351184] setup-gitlab-start[2512]: branch 'master' set up to track 'origin/master'.1813gitlab # [ 193.354777] systemd[1]: Finished setup-gitlab.service.1814gitlab # [ 193.361640] systemd[1]: Starting nixbot CI service...1815gitlab: (finished: waiting for unit setup-gitlab.service, in 194.31 seconds)1816gitlab: waiting for unit nixbot.service1817gitlab # [ 194.440868] nixbot[2593]: {"ts": "2026-09-13T10:48:20.872Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1818gitlab # [ 194.474562] nixbot[2593]: {"ts": "2026-09-13T10:48:20.906Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1819gitlab # [ 194.504181] nixbot[2593]: {"ts": "2026-09-13T10:48:20.936Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1820gitlab # [ 194.511517] nixbot[2593]: {"ts": "2026-09-13T10:48:20.943Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1821gitlab # [ 194.518672] nixbot[2593]: {"ts": "2026-09-13T10:48:20.951Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1822gitlab # [ 194.528899] nixbot[2593]: {"ts": "2026-09-13T10:48:20.961Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1823gitlab # [ 194.537055] nixbot[2593]: {"ts": "2026-09-13T10:48:20.969Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1824gitlab # [ 194.541235] nixbot[2593]: {"ts": "2026-09-13T10:48:20.972Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1825gitlab # [ 194.547859] nixbot[2593]: {"ts": "2026-09-13T10:48:20.980Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1826gitlab # [ 194.550575] nixbot[2593]: {"ts": "2026-09-13T10:48:20.982Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1827gitlab # [ 194.557525] nixbot[2593]: {"ts": "2026-09-13T10:48:20.989Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1828gitlab # [ 194.566450] nixbot[2593]: {"ts": "2026-09-13T10:48:20.998Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1829gitlab # [ 194.574578] nixbot[2593]: {"ts": "2026-09-13T10:48:21.006Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1830gitlab # [ 194.581113] nixbot[2593]: {"ts": "2026-09-13T10:48:21.013Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1831gitlab # [ 194.589561] nixbot[2593]: {"ts": "2026-09-13T10:48:21.021Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1832gitlab # [ 194.596743] nixbot[2593]: {"ts": "2026-09-13T10:48:21.028Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1833gitlab # [ 194.600614] nixbot[2593]: {"ts": "2026-09-13T10:48:21.032Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1834gitlab # [ 194.603230] nixbot[2593]: {"ts": "2026-09-13T10:48:21.035Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1835gitlab # [ 194.609288] nixbot[2593]: {"ts": "2026-09-13T10:48:21.041Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1836gitlab # [ 194.611938] nixbot[2593]: {"ts": "2026-09-13T10:48:21.044Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1837gitlab # [ 194.614679] nixbot[2593]: {"ts": "2026-09-13T10:48:21.047Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1838gitlab # [ 194.621717] nixbot[2593]: {"ts": "2026-09-13T10:48:21.054Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1839gitlab # [ 194.624745] nixbot[2593]: {"ts": "2026-09-13T10:48:21.057Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1840gitlab # [ 194.630072] nixbot[2593]: {"ts": "2026-09-13T10:48:21.062Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1841gitlab # [ 194.634444] nixbot[2593]: {"ts": "2026-09-13T10:48:21.066Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1842gitlab # [ 194.639878] nixbot[2593]: {"ts": "2026-09-13T10:48:21.072Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1843gitlab # [ 194.645446] nixbot[2593]: {"ts": "2026-09-13T10:48:21.077Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1844gitlab # [ 194.649905] nixbot[2593]: {"ts": "2026-09-13T10:48:21.082Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1845gitlab # [ 194.653953] nixbot[2593]: {"ts": "2026-09-13T10:48:21.086Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1846gitlab # [ 194.665472] nixbot[2593]: {"ts": "2026-09-13T10:48:21.097Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1847gitlab # [ 194.670975] nixbot[2593]: {"ts": "2026-09-13T10:48:21.103Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1848gitlab # [ 194.675203] nixbot[2593]: {"ts": "2026-09-13T10:48:21.107Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1849gitlab # [ 194.679806] nixbot[2593]: {"ts": "2026-09-13T10:48:21.111Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1850gitlab # [ 194.687096] nixbot[2593]: {"ts": "2026-09-13T10:48:21.119Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1851gitlab # [ 194.691422] nixbot[2593]: {"ts": "2026-09-13T10:48:21.123Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1852gitlab # [ 194.701464] nixbot[2593]: {"ts": "2026-09-13T10:48:21.133Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1853gitlab # [ 195.061537] nixbot[2593]: INFO: Started server process [2593]1854gitlab # [ 195.063151] nixbot[2593]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1855gitlab # [ 195.081089] nixbot[2593]: INFO: ::ffff:127.0.0.1:53868 - "GET /health HTTP/1.1" 200 OK1856gitlab # [ 195.086706] systemd[1]: Started nixbot CI service.1857gitlab # [ 195.087844] systemd[1]: Reached target Multi-User System.1858gitlab # [ 195.089980] systemd[1]: Startup finished in 1.200s (kernel) + 3.480s (initrd) + 3min 10.408s (userspace) = 3min 15.089s.1859gitlab # [ 195.280561] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:21 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1971860gitlab # [ 195.281115] nixbot[2593]: {"ts": "2026-09-13T10:48:21.711Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1861gitlab # [ 195.295181] nixbot[2593]: {"ts": "2026-09-13T10:48:21.727Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1862gitlab # [ 195.343078] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 401863gitlab # [ 195.344211] nixbot[2593]: {"ts": "2026-09-13T10:48:21.776Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1864gitlab # [ 195.344903] nixbot[2593]: {"ts": "2026-09-13T10:48:21.777Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1865gitlab # [ 195.517357] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 1671866gitlab # [ 195.518848] nixbot[2593]: {"ts": "2026-09-13T10:48:21.950Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1867gitlab: (finished: waiting for unit nixbot.service, in 2.06 seconds)1868gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1869gitlab # [ 195.801910] nixbot[2593]: INFO: ::ffff:127.0.0.1:53884 - "GET /health HTTP/1.1" 200 OK1870gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.02 seconds)1871subtest: project discovered and webhook registered1872gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1873gitlab # [ 195.874707] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 461874gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.07 seconds)1875(finished: subtest: project discovered and webhook registered, in 0.07 seconds)1876subtest: push delivers the webhook1877gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1878gitlab # [ 196.401671] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:22 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 8691879gitlab # [ 196.402844] nixbot[2593]: {"ts": "2026-09-13T10:48:22.834Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1880gitlab # [ 196.478372] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 641881gitlab # [ 196.483913] nixbot[2593]: {"ts": "2026-09-13T10:48:22.916Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1882gitlab # [ 196.535563] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:22 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 411883gitlab # [ 196.542058] nixbot[2593]: {"ts": "2026-09-13T10:48:22.973Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1884gitlab # [ 196.611816] gitaly[889]: time="2026-09-13T10:48:23.043Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63T69W8S72QX80BNB8AAW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-13T10:48:53.031" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:48:23.031" grpc.time_ms=11.643 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1885gitlab # [ 196.658677] gitaly[889]: time="2026-09-13T10:48:23.090Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63T69W8S72QX80BNB8AAW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:48:53.089" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:48:23.090" grpc.time_ms=0.699 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1886gitlab # [ 196.684162] gitaly[889]: time="2026-09-13T10:48:23.116Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63T69W8S72QX80BNB8AAW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-13T10:48:33.009" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:48:23.109" grpc.time_ms=6.709 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1887gitlab # [ 196.726278] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1731888gitlab # [ 196.727367] nixbot[2593]: {"ts": "2026-09-13T10:48:23.159Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1889gitlab # [ 196.801951] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 701890gitlab # [ 196.803067] nixbot[2593]: {"ts": "2026-09-13T10:48:23.235Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1891gitlab # [ 196.815361] nixbot[2593]: {"ts": "2026-09-13T10:48:23.247Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1892gitlab # [ 196.917763] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 551893gitlab # [ 196.920187] gitaly[889]: time="2026-09-13T10:48:23.352Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D63TFYV9CT3000DM82AE31 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:23.334" grpc.time_ms=11.158 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1894gitlab # [ 197.048085] gitaly[889]: time="2026-09-13T10:48:23.480Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63TJN6S1YDFWP0T4NBWF2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:23.472" pid=889 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1895gitlab # [ 197.048954] gitaly[889]: time="2026-09-13T10:48:23.480Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63TJN6S1YDFWP0T4NBWF2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:23.472" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1896gitlab # [ 197.049596] gitaly[889]: time="2026-09-13T10:48:23.481Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63TJN6S1YDFWP0T4NBWF2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:23.472" grpc.time_ms=8.054 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1897gitlab # [ 197.106320] gitlab-workhorse[823]: time="2026-09-13T10:48:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131898gitlab # [ 197.107065] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1571899gitlab # [ 197.161168] gitaly[889]: time="2026-09-13T10:48:23.593Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63TQQW2HKQ35KYVZNNZJC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:23.582" pid=889 remote_ip="2001:db8:1::1" request_sha=a1e681c9eab830ab260ca80f70f42c37410be1e9 response_bytes=223 span.kind=server system=grpc1900gitlab # [ 197.179448] gitaly[889]: time="2026-09-13T10:48:23.593Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1206 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63TQQW2HKQ35KYVZNNZJC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:23.582" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1901gitlab # [ 197.194684] gitaly[889]: time="2026-09-13T10:48:23.627Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1206 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63TQQW2HKQ35KYVZNNZJC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:23.582" grpc.time_ms=29.816 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1902gitlab # [ 197.207730] gitlab-workhorse[823]: time="2026-09-13T10:48:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231903gitlab # [ 197.208668] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 971904gitlab # [ 197.290200] gitaly[889]: time="2026-09-13T10:48:23.722Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D63TW0GY1ERY7C7468VPQV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:23.713" grpc.time_ms=8.911 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1905gitlab # [ 197.308464] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 601906gitlab # [ 197.346781] gitaly[889]: time="2026-09-13T10:48:23.779Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63TXZTEX8FPMJ1N7DVCH6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:23.772" pid=889 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1907gitlab # [ 197.363774] gitaly[889]: time="2026-09-13T10:48:23.779Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63TXZTEX8FPMJ1N7DVCH6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:23.772" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1908gitlab # [ 197.376971] gitaly[889]: time="2026-09-13T10:48:23.809Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63TXZTEX8FPMJ1N7DVCH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:23.772" grpc.time_ms=36.332 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1909gitlab # [ 197.377884] gitlab-workhorse[823]: time="2026-09-13T10:48:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671910gitlab # [ 197.378751] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 661911gitlab # [ 197.450174] gitaly[889]: time="2026-09-13T10:48:23.882Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2D63V16B8NEY9AZD23AC4BH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:23.875" grpc.time_ms=7.263 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1912gitlab # [ 197.469497] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 551913gitlab # [ 197.512052] gitaly[889]: time="2026-09-13T10:48:23.944Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63V30V2S31S5TT8RJXNQA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:23.934" pid=889 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1914gitlab # [ 197.530059] gitaly[889]: time="2026-09-13T10:48:23.944Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1163 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63V30V2S31S5TT8RJXNQA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:23.934" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1915gitlab # [ 197.545427] gitaly[889]: time="2026-09-13T10:48:23.977Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1163 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63V30V2S31S5TT8RJXNQA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:23.934" grpc.time_ms=43.184 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1916gitlab # [ 197.558671] gitlab-workhorse[823]: time="2026-09-13T10:48:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091917gitlab # [ 197.559457] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 861918gitlab # [ 197.632284] gitaly[889]: time="2026-09-13T10:48:24.064Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:48:54.063" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:48:24.063" grpc.time_ms=0.594 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1919gitlab # [ 197.660515] gitaly[889]: time="2026-09-13T10:48:24.092Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-13T10:48:54.086" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:48:24.086" grpc.time_ms=6.417 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1920gitlab # [ 197.685957] gitaly[889]: time="2026-09-13T10:48:24.118Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:48:34.013" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:48:24.113" grpc.time_ms=5.028 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1921gitlab # [ 197.697892] gitaly[889]: time="2026-09-13T10:48:24.127Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:48:34.022" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:48:24.122" grpc.time_ms=4.404 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1922gitlab # [ 197.733025] gitaly[889]: time="2026-09-13T10:48:24.165Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-13T10:48:34.064" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:24.165" grpc.time_ms=0.173 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1923gitlab # [ 197.741591] gitaly[889]: time="2026-09-13T10:48:24.174Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-13T10:48:34.069" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:48:24.169" grpc.time_ms=4.56 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1924gitlab # [ 197.781200] gitaly[889]: time="2026-09-13T10:48:24.213Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4146 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:48:24.213" grpc.time_ms=0.283 pid=889 span.kind=server system=grpc1925gitlab # [ 197.807188] gitaly[889]: time="2026-09-13T10:48:24.239Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:48:24.239" grpc.time_ms=0.202 pid=889 span.kind=server system=grpc1926gitlab # [ 197.824709] gitaly[889]: time="2026-09-13T10:48:24.257Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 diskcache=5973ea2b-5312-4cab-828e-95b532ebcabf grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-13T10:48:34.087" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:24.188" pid=889 ref=refs/keep-around/2011f83c42fa2923de0800d2cc9fee902911eb2d remote_ip="2001:db8:1::1" revision=2011f83c42fa2923de0800d2cc9fee902911eb2d span.kind=server system=grpc username=root1927gitlab # [ 197.825233] gitaly[889]: time="2026-09-13T10:48:24.257Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=54 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5398 command.oublock=8 command.real_time_ms=61 command.spawn_token_fork_ms=0 command.system_time_ms=31 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-13T10:48:34.087" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:48:24.188" grpc.time_ms=69.209 pid=889 ref=refs/keep-around/2011f83c42fa2923de0800d2cc9fee902911eb2d remote_ip="2001:db8:1::1" revision=2011f83c42fa2923de0800d2cc9fee902911eb2d span.kind=server system=grpc username=root1928gitlab # [ 197.852060] gitaly[889]: time="2026-09-13T10:48:24.284Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:48:54.283" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:48:24.284" grpc.time_ms=0.296 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1929gitlab # [ 197.967910] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2011f83c42fa2923de0800d2cc9fee902911eb2d HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 3731930gitlab # [ 197.973576] nixbot[2593]: {"ts": "2026-09-13T10:48:24.401Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2011f83c42fa2923de0800d2cc9fee902911eb2d \"HTTP/1.1 201 Created\""}1931gitlab # [ 197.978876] nixbot[2593]: {"ts": "2026-09-13T10:48:24.409Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-2011f83c42fa-0"}1932gitlab # [ 198.172383] nixbot[2593]: {"ts": "2026-09-13T10:48:24.604Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-2011f83c42fa-0", "argv0": "bwrap"}1933gitlab # [ 198.269720] systemd[1]: Started Nix Daemon.1934gitlab # [ 198.330173] nix-daemon[2758]: accepted connection from pid 2753, user nixbot1935gitlab # [ 202.933750] nix-daemon[2758]: accepted connection from pid 2801, user nixbot1936gitlab # [ 202.948120] nix-daemon[2758]: accepted connection from pid 2753, user nixbot1937gitlab # [ 207.339224] nix-daemon[2758]: accepted connection from pid 2753, user nixbot1938gitlab # [ 207.435766] nix-daemon[2758]: accepted connection from pid 2850, user nixbot1939gitlab # [ 207.470564] gitaly[889]: time="2026-09-13T10:48:33.902Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D644SQN6N0C680WM5F7F73 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:03.601" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:48:33.901" grpc.time_ms=0.626 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1940gitlab # [ 207.500873] gitaly[889]: time="2026-09-13T10:48:33.933Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2D644SQN6N0C680WM5F7F73 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:48:43.224" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:48:33.924" grpc.time_ms=8.14 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1941gitlab # [ 207.544552] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:33 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2011f83c42fa2923de0800d2cc9fee902911eb2d HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1281942gitlab # [ 207.550882] nixbot[2593]: {"ts": "2026-09-13T10:48:33.982Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2011f83c42fa2923de0800d2cc9fee902911eb2d \"HTTP/1.1 201 Created\""}1943gitlab # [ 207.632693] gitaly[889]: time="2026-09-13T10:48:34.064Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D644Y1TWT0DXZWADQZEAJN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:04.062" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:48:34.063" grpc.time_ms=0.696 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1944gitlab # [ 207.760252] gitaly[889]: time="2026-09-13T10:48:34.192Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D644Y1TWT0DXZWADQZEAJN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:48:44.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:48:34.183" grpc.time_ms=8.95 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1945gitlab # [ 207.888093] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2011f83c42fa2923de0800d2cc9fee902911eb2d HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3351946gitlab # [ 207.889427] nixbot[2593]: {"ts": "2026-09-13T10:48:34.321Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2011f83c42fa2923de0800d2cc9fee902911eb2d \"HTTP/1.1 201 Created\""}1947gitlab # [ 212.063545] nix-daemon[2758]: accepted connection from pid 2926, user nixbot1948gitlab # [ 212.151378] gitaly[889]: time="2026-09-13T10:48:38.582Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D649BZ0W8JQF6J2GTVNWA3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:08.281" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:48:38.581" grpc.time_ms=0.919 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 212.193726] gitaly[889]: time="2026-09-13T10:48:38.626Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D649BZ0W8JQF6J2GTVNWA3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:48:48.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:48:38.614" grpc.time_ms=11.496 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1950gitlab # [ 212.234679] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:38 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2011f83c42fa2923de0800d2cc9fee902911eb2d HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1371951gitlab # [ 212.236544] nixbot[2593]: {"ts": "2026-09-13T10:48:38.666Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2011f83c42fa2923de0800d2cc9fee902911eb2d \"HTTP/1.1 201 Created\""}1952gitlab # [ 212.542745] gitaly[889]: time="2026-09-13T10:48:38.975Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D649R2ZEPDB44R131WTN4Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:38.966" grpc.time_ms=8.741 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1953gitlab # [ 212.565049] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:38 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 621954gitlab # [ 212.619161] gitaly[889]: time="2026-09-13T10:48:39.051Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2D649TPJS9SPEX2T35D0AS0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:39.038" pid=889 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1955gitlab # [ 212.640162] gitaly[889]: time="2026-09-13T10:48:39.051Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D649TPJS9SPEX2T35D0AS0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:39.038" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1956gitlab # [ 212.659943] gitlab-workhorse[823]: time="2026-09-13T10:48:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671957gitlab # [ 212.661801] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 531958gitlab # [ 212.663619] gitaly[889]: time="2026-09-13T10:48:39.072Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D649TPJS9SPEX2T35D0AS0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:39.038" grpc.time_ms=12.471 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1959gitlab # [ 212.749847] gitaly[889]: time="2026-09-13T10:48:39.182Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D649YRYKS7JRCDYR6Y9XS1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:39.174" grpc.time_ms=6.697 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1960gitlab # [ 212.776086] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 531961gitlab # [ 212.790258] gitaly[889]: time="2026-09-13T10:48:39.222Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2D64A0FSBQE4XP7T9DT09VT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:39.215" pid=889 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1962gitlab # [ 212.799413] gitaly[889]: time="2026-09-13T10:48:39.222Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D64A0FSBQE4XP7T9DT09VT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:39.215" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1963gitlab # [ 212.811244] gitlab-workhorse[823]: time="2026-09-13T10:48:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671964gitlab # [ 212.813049] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:48:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 391965gitlab # [ 212.814921] gitaly[889]: time="2026-09-13T10:48:39.222Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D64A0FSBQE4XP7T9DT09VT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:48:39.215" grpc.time_ms=6.977 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1966gitlab # [ 212.845156] sidekiq-cluster[2474]: 2026-09-13T10:48:39.277Z pid=2474 tid=xs2 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2474, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434438144}1967gitlab # [ 213.013670] sidekiq-cluster[2474]: W, [2026-09-13T10:48:39.445854 #2474] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1968gitlab # [ 213.050455] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:48:39.482Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1969gitlab # [ 214.688939] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:48:41.120Z","message":"GitLab reliable fetch activated!"}1970gitlab # [ 214.692785] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:48:41.120Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1971gitlab # [ 233.754346] postgres[3151]: [3151] ERROR: relation "table_without_models" does not exist1972gitlab # [ 233.757127] postgres[3151]: [3151] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1973gitlab # [ 236.109301] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:02.541Z","message":"Booted Rails 7.2.3.1 application in production environment"}1974gitlab # [ 236.112661] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:02.544Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1975gitlab # [ 236.114457] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:02.545Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1976gitlab # [ 236.116167] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:02.545Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1977gitlab # [ 236.118108] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:02.547Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1978gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 40.47 seconds)1979gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1980gitlab # [ 236.441241] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:02 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 361981gitlab # [ 236.553217] gitaly[889]: time="2026-09-13T10:49:02.984Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D6514TBYY2X7MM13NKG2NX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:02.974" grpc.time_ms=10.622 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1982gitlab # [ 236.582105] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:02 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 1101983gitlab # Enumerating objects: 5, done.1984gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1985gitlab # Delta compression using up to 4 threads1986gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1987gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 272 bytes | 272.00 KiB/s, done.1988gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1989gitlab # [ 236.814120] gitaly[889]: time="2026-09-13T10:49:03.246Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=327 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-13T10:49:33.234" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-13T10:49:03.234" grpc.time_ms=11.683 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1990gitlab # [ 236.876198] gitaly[889]: time="2026-09-13T10:49:03.308Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M2D6519TATVGN8MSP6ZM9T63 duration_ms=126ns method=POST pid=889 status=200 url="http://unix/api/v4/internal/allowed"1991gitlab # [ 236.910538] gitaly[889]: time="2026-09-13T10:49:03.342Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M2D6519TATVGN8MSP6ZM9T63 duration_ms=27ns method=POST pid=889 status=200 url="http://unix/api/v4/internal/pre_receive"1992gitlab # [ 236.917369] gitaly[889]: time="2026-09-13T10:49:03.349Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5307 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:03.181" grpc.time_ms=167.972 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1993gitlab # [ 236.963556] gitaly[889]: time="2026-09-13T10:49:03.395Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4777 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:03.394" grpc.time_ms=0.95 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1994gitlab # [ 237.010379] gitaly[889]: time="2026-09-13T10:49:03.442Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4776 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:03.442" grpc.time_ms=0.388 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1995gitlab # [ 237.046039] gitaly[889]: time="2026-09-13T10:49:03.478Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:03.478" grpc.time_ms=0.332 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1996gitlab # [ 237.131960] gitaly[889]: time="2026-09-13T10:49:03.564Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M2D6519TATVGN8MSP6ZM9T63 duration_ms=56ns method=POST pid=889 status=200 url="http://unix/api/v4/internal/post_receive"1997gitlab # [ 237.132840] gitaly[889]: time="2026-09-13T10:49:03.564Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4801 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:03.507" grpc.time_ms=57.341 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1998gitlab # [ 237.168728] gitaly[889]: time="2026-09-13T10:49:03.601Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 diskcache=7f9502a0-dd94-4b73-bd54-07c17cea37a6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:03.105" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1999gitlab # [ 237.185236] gitaly[889]: time="2026-09-13T10:49:03.617Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=211 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=872448 command.minflt=13770 command.oublock=32 command.real_time_ms=486 command.spawn_token_fork_ms=0 command.system_time_ms=134 command.user_time_ms=77 component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=604 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:03.105" grpc.time_ms=495.532 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2000gitlab # [ 237.197679] gitlab-workhorse[823]: time="2026-09-13T10:49:03Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=522001gitlab # [ 237.198550] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:03 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5952002gitlab # To http://gitlab/root/test-flake.git2003gitlab # 2011f83..cdbccfd master -> master2004gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.87 seconds)2005gitlab: must succeed: git -C /tmp/test-flake rev-parse master2006gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)2007gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9'2008gitlab # [ 237.310067] nixbot[2593]: INFO: ::ffff:127.0.0.1:59754 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9 HTTP/1.1" 200 OK2009gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9', in 0.09 seconds)2010gitlab # [ 237.401540] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:03.832Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"655a0b9f1415b0ad54d33c3a","created_at":"2026-09-13T10:48:12.631Z","trace_propagation_headers":{"sentry-trace":"58c17f44118e45c59689bac344fbe5c8-9ce13296b7d44d3c","baggage":"sentry-trace_id=58c17f44118e45c59689bac344fbe5c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63FENNJA2CRWGJNSVJMHP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:12.652Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-655a0b9f1415b0ad54d33c3a: start","job_status":"start","queue_duration_s":51.180046,"scheduling_latency_s":51.180081}2011gitlab # [ 237.559544] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:03.991Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"655a0b9f1415b0ad54d33c3a","created_at":"2026-09-13T10:48:12.631Z","trace_propagation_headers":{"sentry-trace":"58c17f44118e45c59689bac344fbe5c8-9ce13296b7d44d3c","baggage":"sentry-trace_id=58c17f44118e45c59689bac344fbe5c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63FENNJA2CRWGJNSVJMHP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:12.652Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-655a0b9f1415b0ad54d33c3a: done: 0.158732 sec","job_status":"done","queue_duration_s":51.180046,"scheduling_latency_s":51.180081,"redis_calls":25,"redis_duration_s":0.005733,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.00314,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001374,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001219,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08260575,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.158732,"completed_at":"2026-09-13T10:49:03.991Z","load_balancing_strategy":"primary","db_duration_s":0.05985,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2012gitlab # [ 237.562446] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:03.992Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"ea896587af79839a0ce5dec8","created_at":"2026-09-13T10:48:12.660Z","trace_propagation_headers":{"sentry-trace":"58c17f44118e45c59689bac344fbe5c8-9ce13296b7d44d3c","baggage":"sentry-trace_id=58c17f44118e45c59689bac344fbe5c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63FENNJA2CRWGJNSVJMHP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:12.663Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-ea896587af79839a0ce5dec8: start","job_status":"start","queue_duration_s":51.329066,"scheduling_latency_s":51.32908}2013gitlab # [ 237.635659] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:04.067Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"ea896587af79839a0ce5dec8","created_at":"2026-09-13T10:48:12.660Z","trace_propagation_headers":{"sentry-trace":"58c17f44118e45c59689bac344fbe5c8-9ce13296b7d44d3c","baggage":"sentry-trace_id=58c17f44118e45c59689bac344fbe5c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63FENNJA2CRWGJNSVJMHP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:12.663Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-ea896587af79839a0ce5dec8: done: 0.074913 sec","job_status":"done","queue_duration_s":51.329066,"scheduling_latency_s":51.32908,"redis_calls":14,"redis_duration_s":0.003092,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000644,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.058886812999999996,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.074913,"completed_at":"2026-09-13T10:49:04.067Z","load_balancing_strategy":"primary","db_duration_s":0.022041,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2014gitlab # [ 237.643067] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:04.069Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"50097bc88f437fb712523612","created_at":"2026-09-13T10:48:13.178Z","trace_propagation_headers":{"sentry-trace":"58c17f44118e45c59689bac344fbe5c8-9ce13296b7d44d3c","baggage":"sentry-trace_id=58c17f44118e45c59689bac344fbe5c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63FENNJA2CRWGJNSVJMHP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:13.183Z","job_size_bytes":5,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-50097bc88f437fb712523612: start","job_status":"start","queue_duration_s":50.885968,"scheduling_latency_s":50.885982}2015gitlab # [ 237.749159] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:04.181Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"50097bc88f437fb712523612","created_at":"2026-09-13T10:48:13.178Z","trace_propagation_headers":{"sentry-trace":"58c17f44118e45c59689bac344fbe5c8-9ce13296b7d44d3c","baggage":"sentry-trace_id=58c17f44118e45c59689bac344fbe5c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63FENNJA2CRWGJNSVJMHP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:13.183Z","job_size_bytes":5,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-50097bc88f437fb712523612: done: 0.112158 sec","job_status":"done","queue_duration_s":50.885968,"scheduling_latency_s":50.885982,"redis_calls":12,"redis_duration_s":0.002567,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000658,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001504,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000279086,"duration_s":0.112158,"completed_at":"2026-09-13T10:49:04.181Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024245,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2016gitlab # [ 237.751551] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:04.182Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"bdb445665822610229557381","created_at":"2026-09-13T10:48:13.203Z","trace_propagation_headers":{"sentry-trace":"58c17f44118e45c59689bac344fbe5c8-9ce13296b7d44d3c","baggage":"sentry-trace_id=58c17f44118e45c59689bac344fbe5c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63FENNJA2CRWGJNSVJMHP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:13.206Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-bdb445665822610229557381: start","job_status":"start","queue_duration_s":50.976483,"scheduling_latency_s":50.976497}2017gitlab # [ 237.898831] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:04.330Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"bdb445665822610229557381","created_at":"2026-09-13T10:48:13.203Z","trace_propagation_headers":{"sentry-trace":"58c17f44118e45c59689bac344fbe5c8-9ce13296b7d44d3c","baggage":"sentry-trace_id=58c17f44118e45c59689bac344fbe5c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63FENNJA2CRWGJNSVJMHP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:13.206Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-bdb445665822610229557381: done: 0.14831 sec","job_status":"done","queue_duration_s":50.976483,"scheduling_latency_s":50.976497,"redis_calls":11,"redis_duration_s":0.002404,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00065,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001348,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.124,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.124,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07849,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000348368,"duration_s":0.14831,"completed_at":"2026-09-13T10:49:04.330Z","load_balancing_strategy":"primary","db_duration_s":0.069661,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2018gitlab # [ 237.901690] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:04.332Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"a8732c36b76cd74145ba43c3","created_at":"2026-09-13T10:48:13.208Z","trace_propagation_headers":{"sentry-trace":"58c17f44118e45c59689bac344fbe5c8-9ce13296b7d44d3c","baggage":"sentry-trace_id=58c17f44118e45c59689bac344fbe5c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63FENNJA2CRWGJNSVJMHP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:13.210Z","job_size_bytes":89,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-a8732c36b76cd74145ba43c3: start","job_status":"start","queue_duration_s":51.12139,"scheduling_latency_s":51.121404}2019gitlab # [ 237.970722] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:04.357Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"a8732c36b76cd74145ba43c3","created_at":"2026-09-13T10:48:13.208Z","trace_propagation_headers":{"sentry-trace":"58c17f44118e45c59689bac344fbe5c8-9ce13296b7d44d3c","baggage":"sentry-trace_id=58c17f44118e45c59689bac344fbe5c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63FENNJA2CRWGJNSVJMHP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:13.210Z","job_size_bytes":89,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-a8732c36b76cd74145ba43c3: done: 0.025371 sec","job_status":"done","queue_duration_s":51.12139,"scheduling_latency_s":51.121404,"redis_calls":11,"redis_duration_s":0.002286,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000655,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001243,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000388,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000276293,"duration_s":0.025371,"completed_at":"2026-09-13T10:49:04.357Z","load_balancing_strategy":"primary","db_duration_s":0.005275,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2020gitlab # [ 238.018006] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:04.358Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 2011f83c42fa2923de0800d2cc9fee902911eb2d refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2a59091f41b1d2e152c21755","created_at":"2026-09-13T10:48:19.626Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-dcee8d90607342c2","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:19.630Z","job_size_bytes":185,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2a59091f41b1d2e152c21755: start","job_status":"start","queue_duration_s":44.728576,"scheduling_latency_s":44.728589}2021gitlab # [ 238.018935] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:04.369Z","message":"changes: \"0000000000000000000000000000000000000000 2011f83c42fa2923de0800d2cc9fee902911eb2d refs/heads/master\\n\""}2022gitlab # [ 238.020450] gitaly[889]: time="2026-09-13T10:49:04.396Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:49:14.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:04.389" grpc.time_ms=6.761 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2023gitlab # [ 238.021404] gitaly[889]: time="2026-09-13T10:49:04.405Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T10:49:14.019" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:49:04.400" grpc.time_ms=5.071 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2024gitlab # [ 238.021982] gitaly[889]: time="2026-09-13T10:49:04.446Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-13T10:49:14.057" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:04.437" grpc.time_ms=9.264 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2025gitlab # [ 238.078076] gitaly[889]: time="2026-09-13T10:49:04.510Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3929 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:04.510" grpc.time_ms=0.318 pid=889 span.kind=server system=grpc2026gitlab # [ 238.112751] gitaly[889]: time="2026-09-13T10:49:04.545Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3931 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:04.544" grpc.time_ms=0.265 pid=889 span.kind=server system=grpc2027gitlab # [ 238.130337] gitaly[889]: time="2026-09-13T10:49:04.562Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW diskcache=2972a0be-f028-422e-aba1-7b5386dda34b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-13T10:49:14.075" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:49:04.455" pid=889 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2028gitlab # [ 238.140348] gitaly[889]: time="2026-09-13T10:49:04.572Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=78 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4891 command.oublock=8 command.real_time_ms=99 command.spawn_token_fork_ms=0 command.system_time_ms=53 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-13T10:49:14.075" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:49:04.455" grpc.time_ms=107.193 pid=889 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2029gitlab # [ 238.152500] gitaly[889]: time="2026-09-13T10:49:04.578Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T10:49:14.197" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:49:04.577" grpc.time_ms=0.188 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2030gitlab # [ 238.163066] gitaly[889]: time="2026-09-13T10:49:04.595Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=938 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-13T10:49:14.202" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:04.582" grpc.time_ms=12.463 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2031gitlab # [ 238.235911] gitaly[889]: time="2026-09-13T10:49:04.668Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-13T10:49:34.062" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:04.663" grpc.time_ms=5.076 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2032gitlab # [ 238.263954] gitaly[889]: time="2026-09-13T10:49:04.689Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-13T10:49:14.008" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:49:04.689" grpc.time_ms=0.453 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2033gitlab # [ 238.264937] gitaly[889]: time="2026-09-13T10:49:04.697Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=340 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-13T10:49:14.012" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-13T10:49:04.693" grpc.time_ms=4.252 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2034gitlab # [ 238.288255] gitaly[889]: time="2026-09-13T10:49:04.720Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:49:14.033" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:04.713" grpc.time_ms=6.901 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2035gitlab # [ 238.297271] gitaly[889]: time="2026-09-13T10:49:04.729Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:49:14.044" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:04.725" grpc.time_ms=4.58 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2036gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9'2037gitlab # [ 238.317086] gitaly[889]: time="2026-09-13T10:49:04.749Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-13T10:49:34.140" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:04.740" grpc.time_ms=9.233 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2038gitlab # [ 238.343700] nixbot[2593]: INFO: ::ffff:127.0.0.1:59764 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9 HTTP/1.1" 200 OK2039gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9', in 0.03 seconds)2040gitlab # [ 238.725133] gitaly[889]: time="2026-09-13T10:49:05.157Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-13T10:49:15.005" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:05.156" grpc.time_ms=1.142 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2041gitlab # [ 238.748542] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:05.179Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 2011f83c42fa2923de0800d2cc9fee902911eb2d refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2a59091f41b1d2e152c21755","created_at":"2026-09-13T10:48:19.626Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-dcee8d90607342c2","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:48:19.630Z","job_size_bytes":185,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2a59091f41b1d2e152c21755: done: 0.821081 sec","job_status":"done","queue_duration_s":44.728576,"scheduling_latency_s":44.728589,"gitaly_calls":13,"gitaly_duration_s":0.205791,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.042762,"redis_read_bytes":2103,"redis_write_bytes":21749,"redis_cache_calls":15,"redis_cache_duration_s":0.005108,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.005826,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001631,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7837,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004474,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.014418,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.011305,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.174,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.196,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.501948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000446425,"exclusive_lock_hold_duration_s":0.020565462,"duration_s":0.821081,"completed_at":"2026-09-13T10:49:05.179Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.091916,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2042gitlab # [ 238.818525] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:05.181Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1a5e432f47ec6c6a931e948b","created_at":"2026-09-13T10:48:24.287Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-f8d4b968aeb848df","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:24.291Z","job_size_bytes":65,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1a5e432f47ec6c6a931e948b: start","job_status":"start","queue_duration_s":40.889507,"scheduling_latency_s":40.889521}2043gitlab # [ 238.819551] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:05.237Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1a5e432f47ec6c6a931e948b","created_at":"2026-09-13T10:48:24.287Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-f8d4b968aeb848df","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:24.291Z","job_size_bytes":65,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1a5e432f47ec6c6a931e948b: done: 0.056625 sec","job_status":"done","queue_duration_s":40.889507,"scheduling_latency_s":40.889521,"redis_calls":16,"redis_duration_s":0.003101,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001876,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000204774,"duration_s":0.056625,"completed_at":"2026-09-13T10:49:05.237Z","load_balancing_strategy":"primary","db_duration_s":0.018874,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2044gitlab # [ 238.869710] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:05.238Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"952bb0db1a0e3ffee45fcc4d","created_at":"2026-09-13T10:48:24.292Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-f8d4b968aeb848df","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:24.298Z","job_size_bytes":65,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-952bb0db1a0e3ffee45fcc4d: start","job_status":"start","queue_duration_s":40.940436,"scheduling_latency_s":40.940449}2045gitlab # [ 238.871229] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:05.303Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"952bb0db1a0e3ffee45fcc4d","created_at":"2026-09-13T10:48:24.292Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-f8d4b968aeb848df","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:24.298Z","job_size_bytes":65,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-952bb0db1a0e3ffee45fcc4d: done: 0.064711 sec","job_status":"done","queue_duration_s":40.940436,"scheduling_latency_s":40.940449,"redis_calls":21,"redis_duration_s":0.0028929999999999997,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.00105,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001132,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194159,"duration_s":0.064711,"completed_at":"2026-09-13T10:49:05.303Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013946,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2046gitlab # [ 238.892755] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:05.304Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8a7ea3a3e1493cb17ccf4986","created_at":"2026-09-13T10:48:24.385Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-f8d4b968aeb848df","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:24.389Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8a7ea3a3e1493cb17ccf4986: start","job_status":"start","queue_duration_s":40.914793,"scheduling_latency_s":40.914806}2047gitlab # [ 238.966053] gitaly[889]: time="2026-09-13T10:49:05.398Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:05.397" grpc.time_ms=0.285 pid=889 span.kind=server system=grpc2048gitlab # [ 238.992873] gitaly[889]: time="2026-09-13T10:49:05.425Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3888 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:05.424" grpc.time_ms=0.583 pid=889 span.kind=server system=grpc2049gitlab # [ 239.020454] gitaly[889]: time="2026-09-13T10:49:05.452Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:05.452" grpc.time_ms=0.302 pid=889 span.kind=server system=grpc2050gitlab # [ 239.039521] gitaly[889]: time="2026-09-13T10:49:05.471Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 diskcache=f9a0b70d-7f7f-44f6-9cd2-70cb37c23591 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T10:49:35.078" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:05.378" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2051gitlab # [ 239.040056] gitaly[889]: time="2026-09-13T10:49:05.472Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=96 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7154 command.oublock=0 command.real_time_ms=86 command.spawn_token_fork_ms=0 command.system_time_ms=69 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T10:49:35.078" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:05.378" grpc.time_ms=93.568 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052gitlab # [ 239.105510] gitaly[889]: time="2026-09-13T10:49:05.537Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-13T10:49:35.236" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:05.536" grpc.time_ms=1.018 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2053gitlab # [ 239.135142] gitaly[889]: time="2026-09-13T10:49:05.567Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63V6T884WZ62TQE10XZZ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:35.266" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:05.566" grpc.time_ms=0.832 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2054gitlab # [ 239.153411] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:05.585Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8a7ea3a3e1493cb17ccf4986","created_at":"2026-09-13T10:48:24.385Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-f8d4b968aeb848df","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:24.389Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2474,"job_status":"rescheduled","message":"PipelineProcessWorker JID-8a7ea3a3e1493cb17ccf4986: rescheduled"}2055gitlab # [ 239.172233] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:05.604Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8a7ea3a3e1493cb17ccf4986","created_at":"2026-09-13T10:48:24.385Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-f8d4b968aeb848df","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T10:48:24.389Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8a7ea3a3e1493cb17ccf4986: done: 0.299992 sec","job_status":"done","queue_duration_s":40.914793,"scheduling_latency_s":40.914806,"gitaly_calls":3,"gitaly_duration_s":0.10188,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.037938,"redis_read_bytes":460,"redis_write_bytes":29291,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000625,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00095,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.005312,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.002102,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15578,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.015753,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.00029,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000282,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.011999,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.014,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.124824,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.243468932,"duration_s":0.299992,"completed_at":"2026-09-13T10:49:05.604Z","load_balancing_strategy":"primary","db_duration_s":0.042163,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2056gitlab # [ 239.220864] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:05.653Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","2011f83c42fa2923de0800d2cc9fee902911eb2d cdbccfdc22fdb0950698128f97da0717df0038d9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0029e0f4756f44a06b3ae9f5","created_at":"2026-09-13T10:49:03.530Z","trace_propagation_headers":{"sentry-trace":"928ab22e5fcc4963a58e9db6cbb57610-542e6d187db04902","baggage":"sentry-trace_id=928ab22e5fcc4963a58e9db6cbb57610,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D6519TATVGN8MSP6ZM9T63","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:49:03.532Z","job_size_bytes":185,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0029e0f4756f44a06b3ae9f5: start","job_status":"start","queue_duration_s":2.120083,"scheduling_latency_s":2.120107}2057gitlab # [ 239.229939] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:05.662Z","message":"changes: \"2011f83c42fa2923de0800d2cc9fee902911eb2d cdbccfdc22fdb0950698128f97da0717df0038d9 refs/heads/master\\n\""}2058gitlab # [ 239.258040] gitaly[889]: time="2026-09-13T10:49:05.690Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:49:15.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:05.684" grpc.time_ms=5.873 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab # [ 239.272917] gitaly[889]: time="2026-09-13T10:49:05.705Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T10:49:15.014" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:49:05.694" grpc.time_ms=10.337 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2060gitlab # [ 239.284898] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:05.709Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2d3873d9a921cd423ee9dd83","created_at":"2026-09-13T10:49:05.707Z","trace_propagation_headers":{"sentry-trace":"928ab22e5fcc4963a58e9db6cbb57610-d0fe438dfa164433","baggage":"sentry-trace_id=928ab22e5fcc4963a58e9db6cbb57610,sentry-release=Unknown"},"correlation_id":"01M2D6519TATVGN8MSP6ZM9T63","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"3f009d3874c00495850ed84e","job_size_bytes":46,"pid":2474,"job_status":"deduplicated","message":"ProjectCacheWorker JID-2d3873d9a921cd423ee9dd83: deduplicated: until executing","deduplication.type":"until executing"}2061gitlab # [ 239.300962] gitaly[889]: time="2026-09-13T10:49:05.733Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-13T10:49:15.043" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:05.723" grpc.time_ms=9.795 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2062gitlab # [ 239.315689] gitaly[889]: time="2026-09-13T10:49:05.748Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-13T10:49:35.137" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:05.737" grpc.time_ms=10.199 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2063gitlab # [ 239.332437] gitaly[889]: time="2026-09-13T10:49:05.764Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=347 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-13T10:49:15.078" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-13T10:49:05.758" grpc.time_ms=6.24 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2064gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9'2065gitlab # [ 239.347996] gitaly[889]: time="2026-09-13T10:49:05.780Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:49:15.090" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:05.770" grpc.time_ms=9.845 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2066gitlab # [ 239.384563] nixbot[2593]: INFO: ::ffff:127.0.0.1:59774 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9 HTTP/1.1" 200 OK2067gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9', in 0.04 seconds)2068gitlab # [ 239.440127] gitaly[889]: time="2026-09-13T10:49:05.872Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-13T10:49:15.191" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:05.871" grpc.time_ms=0.933 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069gitlab # [ 239.452878] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:05.885Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","2011f83c42fa2923de0800d2cc9fee902911eb2d cdbccfdc22fdb0950698128f97da0717df0038d9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0029e0f4756f44a06b3ae9f5","created_at":"2026-09-13T10:49:03.530Z","trace_propagation_headers":{"sentry-trace":"928ab22e5fcc4963a58e9db6cbb57610-542e6d187db04902","baggage":"sentry-trace_id=928ab22e5fcc4963a58e9db6cbb57610,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D6519TATVGN8MSP6ZM9T63","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-13T10:49:03.532Z","job_size_bytes":185,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0029e0f4756f44a06b3ae9f5: done: 0.232085 sec","job_status":"done","queue_duration_s":2.120083,"scheduling_latency_s":2.120107,"gitaly_calls":7,"gitaly_duration_s":0.078353,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.021569,"redis_read_bytes":501,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.002251,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000833,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00328,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.00602,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.009185,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.023,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.023,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.112825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000392787,"exclusive_lock_hold_duration_s":0.015144104,"duration_s":0.232085,"completed_at":"2026-09-13T10:49:05.885Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031145,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2070gitlab # [ 239.496110] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:05.886Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"3f009d3874c00495850ed84e","created_at":"2026-09-13T10:49:04.407Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-5ca401156f0743cb","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:04.419Z","job_size_bytes":46,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-3f009d3874c00495850ed84e: start","job_status":"start","queue_duration_s":1.467019,"scheduling_latency_s":1.467036}2071gitlab # [ 239.496735] gitaly[889]: time="2026-09-13T10:49:05.918Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-13T16:49:05.915" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:49:05.915" grpc.time_ms=2.198 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2072gitlab # [ 239.499363] gitaly[889]: time="2026-09-13T10:49:05.931Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-13T10:49:35.322" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:05.922" grpc.time_ms=8.689 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2073gitlab # [ 239.524209] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:05.956Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"3f009d3874c00495850ed84e","created_at":"2026-09-13T10:49:04.407Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-5ca401156f0743cb","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:04.419Z","job_size_bytes":46,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-3f009d3874c00495850ed84e: done: 0.069653 sec","job_status":"done","queue_duration_s":1.467019,"scheduling_latency_s":1.467036,"gitaly_calls":2,"gitaly_duration_s":0.014027,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006268,"redis_read_bytes":69,"redis_write_bytes":4886,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001397,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000517,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001293,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002399,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000662,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000260089,"duration_s":0.069653,"completed_at":"2026-09-13T10:49:05.956Z","load_balancing_strategy":"primary","db_duration_s":0.011789,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2074gitlab # [ 239.570068] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:05.957Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"19c0bcad153bb135d2ef1f5d","created_at":"2026-09-13T10:49:04.431Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-5ca401156f0743cb","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:04.434Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-19c0bcad153bb135d2ef1f5d: start","job_status":"start","queue_duration_s":1.522783,"scheduling_latency_s":1.522796}2075gitlab # [ 239.571106] gitaly[889]: time="2026-09-13T10:49:05.992Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW diskcache=066afb7d-c78b-44d7-8cc7-b3226e685bae grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-13T16:49:05.970" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:05.970" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2076gitlab # [ 239.571900] gitaly[889]: time="2026-09-13T10:49:05.992Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1285 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-13T16:49:05.970" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:05.970" grpc.time_ms=21.795 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2077gitlab # [ 239.613304] gitaly[889]: time="2026-09-13T10:49:06.041Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-13T10:49:36.035" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:06.035" grpc.time_ms=5.644 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2078gitlab # [ 239.614213] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:06.017Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"19c0bcad153bb135d2ef1f5d","created_at":"2026-09-13T10:49:04.431Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-5ca401156f0743cb","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:04.434Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-19c0bcad153bb135d2ef1f5d: done: 0.060364 sec","job_status":"done","queue_duration_s":1.522783,"scheduling_latency_s":1.522796,"gitaly_calls":1,"gitaly_duration_s":0.023535,"redis_calls":15,"redis_duration_s":0.002381,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00022,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000322,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000862,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.046333263,"duration_s":0.060364,"completed_at":"2026-09-13T10:49:06.017Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011296,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2079gitlab # [ 239.665753] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:06.018Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"54b63c93e2700f485b0f2c98","created_at":"2026-09-13T10:49:04.572Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-5ca401156f0743cb","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:04.574Z","job_size_bytes":23,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-54b63c93e2700f485b0f2c98: start","job_status":"start","queue_duration_s":1.444032,"scheduling_latency_s":1.444046}2080gitlab # [ 239.666823] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:06.047Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"54b63c93e2700f485b0f2c98","created_at":"2026-09-13T10:49:04.572Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-5ca401156f0743cb","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:04.574Z","job_size_bytes":23,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-54b63c93e2700f485b0f2c98: done: 0.028426 sec","job_status":"done","queue_duration_s":1.444032,"scheduling_latency_s":1.444046,"gitaly_calls":1,"gitaly_duration_s":0.007511,"redis_calls":16,"redis_duration_s":0.003206,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000266,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001416,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000618,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028426,"completed_at":"2026-09-13T10:49:06.047Z","load_balancing_strategy":"primary","db_duration_s":0.00138,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2081gitlab # [ 239.688157] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:06.048Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"7f04ecc33ba3b86f1ae827c2","created_at":"2026-09-13T10:49:04.979Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-5ca401156f0743cb","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9e016a5a8b101502342c141a71ee06e3b362b90f047e0dfb7f52c5eb2706c05c","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:04.985Z","job_size_bytes":467,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-7f04ecc33ba3b86f1ae827c2: start","job_status":"start","queue_duration_s":1.062663,"scheduling_latency_s":1.062677}2082gitlab # [ 239.726760] gitaly[889]: time="2026-09-13T10:49:06.063Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:36.062" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:06.063" grpc.time_ms=0.428 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2083gitlab # [ 239.727572] gitaly[889]: time="2026-09-13T10:49:06.071Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-13T10:49:16.006" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:06.067" grpc.time_ms=4.178 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 239.728318] gitaly[889]: time="2026-09-13T10:49:06.141Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-13T10:49:36.140" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:06.140" grpc.time_ms=0.835 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085gitlab # [ 239.736341] gitaly[889]: time="2026-09-13T10:49:06.148Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=326 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-13T10:49:36.143" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:06.143" grpc.time_ms=3.98 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 239.776747] gitaly[889]: time="2026-09-13T10:49:06.202Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:49:16.136" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:06.197" grpc.time_ms=5.576 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 240.195896] gitaly[889]: time="2026-09-13T10:49:06.627Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-13T10:49:36.609" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:06.609" grpc.time_ms=18.002 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab # [ 240.248830] gitaly[889]: time="2026-09-13T10:49:06.681Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2D63PDW7DFE8M4NDRH8GYQW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-13T10:49:36.664" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:06.664" grpc.time_ms=16.385 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2089gitlab # [ 240.282527] sidekiq-cluster[2474]: {"severity":"WARN","time":"2026-09-13T10:49:06.714Z","class":"CreatePipelineWorker","correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"2011f83c42fa2923de0800d2cc9fee902911eb2d","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"2011f83c42fa2923de0800d2cc9fee902911eb2d","ref":"refs/heads/master"},"retry":0}2090gitlab # [ 240.290688] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:06.722Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"7f04ecc33ba3b86f1ae827c2","created_at":"2026-09-13T10:49:04.979Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-5ca401156f0743cb","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9e016a5a8b101502342c141a71ee06e3b362b90f047e0dfb7f52c5eb2706c05c","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:04.985Z","job_size_bytes":467,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-7f04ecc33ba3b86f1ae827c2: done: 0.674572 sec","job_status":"done","queue_duration_s":1.062663,"scheduling_latency_s":1.062677,"gitaly_calls":7,"gitaly_duration_s":0.06534,"redis_calls":51,"redis_duration_s":0.007039,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000541,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003006,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001389,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.537425,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000436368,"duration_s":0.674572,"completed_at":"2026-09-13T10:49:06.722Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031702,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2091gitlab # [ 240.335701] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:06.724Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"568cd878-8022-4ed7-b6da-765051f32a92\"}"],"class":"WebHookWorker","jid":"232fdf8397138ca15b665783","created_at":"2026-09-13T10:49:05.131Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-5ca401156f0743cb","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6dffe5e1cc1d72fa452b1b66946ed016cba6d2764277d898124a447ac672c2ba","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.136Z","job_size_bytes":1751,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-232fdf8397138ca15b665783: start","job_status":"start","queue_duration_s":1.587845,"scheduling_latency_s":1.587871}2092gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9'2093gitlab # [ 240.407112] nixbot[2593]: INFO: ::ffff:127.0.0.1:59788 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2094gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9', in 0.08 seconds)2095gitlab # [ 240.427596] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:06.859Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"568cd878-8022-4ed7-b6da-765051f32a92\"}"],"class":"WebHookWorker","jid":"232fdf8397138ca15b665783","created_at":"2026-09-13T10:49:05.131Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-5ca401156f0743cb","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6dffe5e1cc1d72fa452b1b66946ed016cba6d2764277d898124a447ac672c2ba","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.136Z","job_size_bytes":1751,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-232fdf8397138ca15b665783: done: 0.135071 sec","job_status":"done","queue_duration_s":1.587845,"scheduling_latency_s":1.587871,"redis_calls":19,"redis_duration_s":0.004806,"redis_read_bytes":32,"redis_write_bytes":5366,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000994,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000858,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002007,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.05704356300000768,"cpu_s":0.064355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000465981,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.135071,"completed_at":"2026-09-13T10:49:06.859Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2096gitlab # [ 240.472892] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:06.860Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c549712310f4527de3c79466","created_at":"2026-09-13T10:49:05.368Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.371Z","job_size_bytes":23,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c549712310f4527de3c79466: start","job_status":"start","queue_duration_s":1.489768,"scheduling_latency_s":1.489783}2097gitlab # [ 240.473599] nixbot[2593]: INFO: ::ffff:127.0.0.1:59794 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9 HTTP/1.1" 200 OK2098gitlab # [ 240.485141] gitaly[889]: time="2026-09-13T10:49:06.917Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D6551A0J13GBWN0S4FGHEP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:06.911" grpc.time_ms=5.902 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc2099gitlab # [ 240.486305] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:06 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 592100gitlab # [ 240.496472] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:06.928Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c549712310f4527de3c79466","created_at":"2026-09-13T10:49:05.368Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.371Z","job_size_bytes":23,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c549712310f4527de3c79466: done: 0.067759 sec","job_status":"done","queue_duration_s":1.489768,"scheduling_latency_s":1.489783,"redis_calls":10,"redis_duration_s":0.006979,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006433,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210082,"duration_s":0.067759,"completed_at":"2026-09-13T10:49:06.928Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017896,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2101gitlab # [ 240.504520] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:06.930Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"50b9d0a00143d5b16f56baf8","created_at":"2026-09-13T10:49:05.476Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.479Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-50b9d0a00143d5b16f56baf8: start","job_status":"start","queue_duration_s":1.450631,"scheduling_latency_s":1.450646}2102gitlab # [ 240.548824] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:06.952Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"50b9d0a00143d5b16f56baf8","created_at":"2026-09-13T10:49:05.476Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.479Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-50b9d0a00143d5b16f56baf8: done: 0.022705 sec","job_status":"done","queue_duration_s":1.450631,"scheduling_latency_s":1.450646,"redis_calls":10,"redis_duration_s":0.0023510000000000002,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000307302,"duration_s":0.022705,"completed_at":"2026-09-13T10:49:06.952Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00386,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2103gitlab # [ 240.588786] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:06.953Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6cca37e48ca9b3dcdf212d0e","created_at":"2026-09-13T10:49:05.487Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.492Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6cca37e48ca9b3dcdf212d0e: start","job_status":"start","queue_duration_s":1.461183,"scheduling_latency_s":1.461196}2104gitlab # [ 240.589777] gitlab-workhorse[823]: time="2026-09-13T10:49:06Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672105gitlab # [ 240.590575] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:06 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 422106gitlab # [ 240.590944] gitlab-workhorse[823]: time="2026-09-13T10:49:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3372107gitlab # [ 240.591526] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:07 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 392108gitlab # [ 240.592058] gitaly[889]: time="2026-09-13T10:49:06.962Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2D65538X4G213YSMCXY6JHD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:06.956" pid=889 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2109gitlab # [ 240.592720] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:06.974Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6cca37e48ca9b3dcdf212d0e","created_at":"2026-09-13T10:49:05.487Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.492Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6cca37e48ca9b3dcdf212d0e: done: 0.020891 sec","job_status":"done","queue_duration_s":1.461183,"scheduling_latency_s":1.461196,"redis_calls":10,"redis_duration_s":0.001741,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000215,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000633,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000183263,"duration_s":0.020891,"completed_at":"2026-09-13T10:49:06.974Z","load_balancing_strategy":"primary","db_duration_s":0.003088,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2110gitlab # [ 240.643278] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:06.975Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b011df414ceb6cbba9fec323","created_at":"2026-09-13T10:49:05.500Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.502Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b011df414ceb6cbba9fec323: start","job_status":"start","queue_duration_s":1.473007,"scheduling_latency_s":1.473019}2111gitlab # [ 240.643995] gitaly[889]: time="2026-09-13T10:49:06.962Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D65538X4G213YSMCXY6JHD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:06.956" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc2112gitlab # [ 240.685623] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.001Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b011df414ceb6cbba9fec323","created_at":"2026-09-13T10:49:05.500Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.502Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b011df414ceb6cbba9fec323: done: 0.026114 sec","job_status":"done","queue_duration_s":1.473007,"scheduling_latency_s":1.473019,"redis_calls":13,"redis_duration_s":0.003388,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001996,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000324,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000221816,"duration_s":0.026114,"completed_at":"2026-09-13T10:49:07.001Z","load_balancing_strategy":"primary","db_duration_s":0.003442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2113gitlab # [ 240.687943] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.002Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"581db4430ca1af525c67d034","created_at":"2026-09-13T10:49:05.502Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.505Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-581db4430ca1af525c67d034: start","job_status":"start","queue_duration_s":1.497839,"scheduling_latency_s":1.497856}2114gitlab # [ 240.726797] gitaly[889]: time="2026-09-13T10:49:06.962Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D65538X4G213YSMCXY6JHD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:06.956" grpc.time_ms=5.786 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc2115gitlab # [ 240.727590] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.022Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"581db4430ca1af525c67d034","created_at":"2026-09-13T10:49:05.502Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.505Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-581db4430ca1af525c67d034: done: 0.019655 sec","job_status":"done","queue_duration_s":1.497839,"scheduling_latency_s":1.497856,"redis_calls":10,"redis_duration_s":0.001173,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000231,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000225,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000189968,"duration_s":0.019655,"completed_at":"2026-09-13T10:49:07.022Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00253,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2116gitlab # [ 240.774994] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.026Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"996c453e081b225503105893","created_at":"2026-09-13T10:49:05.505Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.507Z","job_size_bytes":19,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-996c453e081b225503105893: start","job_status":"start","queue_duration_s":1.518799,"scheduling_latency_s":1.518813}2117gitlab # [ 240.775688] gitaly[889]: time="2026-09-13T10:49:07.002Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2D6554K3XF946BJCR6NZEN7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:06.992" pid=889 remote_ip="2001:db8:1::1" request_sha=20a6ecac1b0ec644830240486728affed7048f37 response_bytes=337 span.kind=server system=grpc2118gitlab # [ 240.776457] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.049Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"996c453e081b225503105893","created_at":"2026-09-13T10:49:05.505Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.507Z","job_size_bytes":19,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-996c453e081b225503105893: done: 0.023012 sec","job_status":"done","queue_duration_s":1.518799,"scheduling_latency_s":1.518813,"redis_calls":11,"redis_duration_s":0.00408,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001019,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001872,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001189,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000186337,"duration_s":0.023012,"completed_at":"2026-09-13T10:49:07.049Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003849,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2119gitlab # [ 240.825725] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.050Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"70ede6b335e150279b3439ae","created_at":"2026-09-13T10:49:05.509Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.511Z","job_size_bytes":66,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-70ede6b335e150279b3439ae: start","job_status":"start","queue_duration_s":1.538767,"scheduling_latency_s":1.538779}2120gitlab # [ 240.829747] gitaly[889]: time="2026-09-13T10:49:07.002Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1192 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2D6554K3XF946BJCR6NZEN7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:06.992" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc2121gitlab # [ 240.870800] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.069Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"70ede6b335e150279b3439ae","created_at":"2026-09-13T10:49:05.509Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.511Z","job_size_bytes":66,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-70ede6b335e150279b3439ae: done: 0.018573 sec","job_status":"done","queue_duration_s":1.538767,"scheduling_latency_s":1.538779,"redis_calls":10,"redis_duration_s":0.001123,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000211,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000182147,"duration_s":0.018573,"completed_at":"2026-09-13T10:49:07.069Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2122gitlab # [ 240.880716] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.070Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"6047ca75cfddec53a45bbb94","created_at":"2026-09-13T10:49:05.512Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.514Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6047ca75cfddec53a45bbb94: start","job_status":"start","queue_duration_s":1.555558,"scheduling_latency_s":1.55557}2123gitlab # [ 240.922769] gitaly[889]: time="2026-09-13T10:49:07.002Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1192 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2D6554K3XF946BJCR6NZEN7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:06.992" grpc.time_ms=9.956 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc2124gitlab # [ 240.923553] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.093Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"6047ca75cfddec53a45bbb94","created_at":"2026-09-13T10:49:05.512Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.514Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6047ca75cfddec53a45bbb94: done: 0.023623 sec","job_status":"done","queue_duration_s":1.555558,"scheduling_latency_s":1.55557,"redis_calls":10,"redis_duration_s":0.001477,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000339,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195276,"duration_s":0.023623,"completed_at":"2026-09-13T10:49:07.093Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003514,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2125gitlab # [ 240.978756] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.094Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"898e36f7cb5c44254ce81a9c","created_at":"2026-09-13T10:49:05.517Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.519Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-898e36f7cb5c44254ce81a9c: start","job_status":"start","queue_duration_s":1.574607,"scheduling_latency_s":1.57462}2126gitlab # [ 240.979669] gitaly[889]: time="2026-09-13T10:49:07.223Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 diskcache=8f9708c2-0042-4015-a3e2-7a176c0f31c6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-13T16:49:07.214" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:07.214" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 240.980226] gitaly[889]: time="2026-09-13T10:49:07.224Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=317 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-13T16:49:07.214" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:07.214" grpc.time_ms=8.922 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 240.980890] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.115Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"898e36f7cb5c44254ce81a9c","created_at":"2026-09-13T10:49:05.517Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.519Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-898e36f7cb5c44254ce81a9c: done: 0.021504 sec","job_status":"done","queue_duration_s":1.574607,"scheduling_latency_s":1.57462,"redis_calls":10,"redis_duration_s":0.001246,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203937,"duration_s":0.021504,"completed_at":"2026-09-13T10:49:07.115Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00564,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2129gitlab # [ 241.028120] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.116Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b2da65013599852d9177c865","created_at":"2026-09-13T10:49:05.520Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.522Z","job_size_bytes":6,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b2da65013599852d9177c865: start","job_status":"start","queue_duration_s":1.594663,"scheduling_latency_s":1.594675}2130gitlab # [ 241.031571] gitaly[889]: time="2026-09-13T10:49:07.246Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:37.245" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:07.245" grpc.time_ms=0.353 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2131gitlab # [ 241.042590] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.130Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b2da65013599852d9177c865","created_at":"2026-09-13T10:49:05.520Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.522Z","job_size_bytes":6,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b2da65013599852d9177c865: done: 0.01325 sec","job_status":"done","queue_duration_s":1.594663,"scheduling_latency_s":1.594675,"redis_calls":10,"redis_duration_s":0.001241,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00024,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000736,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000191086,"duration_s":0.01325,"completed_at":"2026-09-13T10:49:07.130Z","load_balancing_strategy":"primary","db_duration_s":0.001291,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2132gitlab # [ 241.096995] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.130Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d4d3258052d66e4108beae91","created_at":"2026-09-13T10:49:05.522Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.524Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d4d3258052d66e4108beae91: start","job_status":"start","queue_duration_s":1.606206,"scheduling_latency_s":1.606219}2133gitlab # [ 241.097714] gitaly[889]: time="2026-09-13T10:49:07.252Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-13T10:49:17.187" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:07.247" grpc.time_ms=4.729 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab # [ 241.135774] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.151Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d4d3258052d66e4108beae91","created_at":"2026-09-13T10:49:05.522Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.524Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d4d3258052d66e4108beae91: done: 0.020125 sec","job_status":"done","queue_duration_s":1.606206,"scheduling_latency_s":1.606219,"redis_calls":10,"redis_duration_s":0.001227,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000327695,"duration_s":0.020125,"completed_at":"2026-09-13T10:49:07.151Z","load_balancing_strategy":"primary","db_duration_s":0.003689,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2135gitlab # [ 241.141735] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.151Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"ac2a349c0151af6dfcdd3f4b","created_at":"2026-09-13T10:49:05.527Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.529Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-ac2a349c0151af6dfcdd3f4b: start","job_status":"start","queue_duration_s":1.622053,"scheduling_latency_s":1.622066}2136gitlab # [ 241.155926] gitaly[889]: time="2026-09-13T10:49:07.272Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-13T10:49:37.271" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:07.271" grpc.time_ms=0.486 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 241.167226] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.187Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"ac2a349c0151af6dfcdd3f4b","created_at":"2026-09-13T10:49:05.527Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.529Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-ac2a349c0151af6dfcdd3f4b: done: 0.035651 sec","job_status":"done","queue_duration_s":1.622053,"scheduling_latency_s":1.622066,"redis_calls":14,"redis_duration_s":0.001879,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000798,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031708,"duration_s":0.035651,"completed_at":"2026-09-13T10:49:07.187Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2138gitlab # [ 241.211081] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.188Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"3372039d89e85ad1ad483486","created_at":"2026-09-13T10:49:05.585Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.599Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3372039d89e85ad1ad483486: start","job_status":"start","queue_duration_s":1.588569,"scheduling_latency_s":1.588582}2139gitlab # [ 241.218935] gitaly[889]: time="2026-09-13T10:49:07.275Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=30 command.oublock=0 command.real_time_ms=0 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-13T10:49:37.274" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:07.274" grpc.time_ms=1.331 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2140gitlab # [ 241.233134] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.203Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"3372039d89e85ad1ad483486","created_at":"2026-09-13T10:49:05.585Z","trace_propagation_headers":{"sentry-trace":"51ea42b8a84d4e0c8f35a7259a06d8cc-e6b60eb20c9948e2","baggage":"sentry-trace_id=51ea42b8a84d4e0c8f35a7259a06d8cc,sentry-release=Unknown"},"correlation_id":"01M2D63V6T884WZ62TQE10XZZ1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.599Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3372039d89e85ad1ad483486: done: 0.015256 sec","job_status":"done","queue_duration_s":1.588569,"scheduling_latency_s":1.588582,"redis_calls":8,"redis_duration_s":0.0009860000000000001,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015256,"completed_at":"2026-09-13T10:49:07.203Z","load_balancing_strategy":"primary","db_duration_s":0.002108,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2141gitlab # [ 241.290091] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.204Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"444dd956e6b54f23a1301fac","created_at":"2026-09-13T10:49:05.716Z","trace_propagation_headers":{"sentry-trace":"928ab22e5fcc4963a58e9db6cbb57610-d0fe438dfa164433","baggage":"sentry-trace_id=928ab22e5fcc4963a58e9db6cbb57610,sentry-release=Unknown"},"correlation_id":"01M2D6519TATVGN8MSP6ZM9T63","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"19c0bcad153bb135d2ef1f5d","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.718Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-444dd956e6b54f23a1301fac: start","job_status":"start","queue_duration_s":1.485875,"scheduling_latency_s":1.485888}2142gitlab # [ 241.290855] gitaly[889]: time="2026-09-13T10:49:07.295Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:49:17.229" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:07.289" grpc.time_ms=5.346 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2143gitlab # [ 241.295862] nixbot[2593]: INFO: ::ffff:127.0.0.1:59804 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2144gitlab # [ 241.296943] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.232Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"444dd956e6b54f23a1301fac","created_at":"2026-09-13T10:49:05.716Z","trace_propagation_headers":{"sentry-trace":"928ab22e5fcc4963a58e9db6cbb57610-d0fe438dfa164433","baggage":"sentry-trace_id=928ab22e5fcc4963a58e9db6cbb57610,sentry-release=Unknown"},"correlation_id":"01M2D6519TATVGN8MSP6ZM9T63","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"19c0bcad153bb135d2ef1f5d","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.718Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-444dd956e6b54f23a1301fac: done: 0.027939 sec","job_status":"done","queue_duration_s":1.485875,"scheduling_latency_s":1.485888,"gitaly_calls":1,"gitaly_duration_s":0.010818,"redis_calls":12,"redis_duration_s":0.001568,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000359,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000595,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.018101183,"duration_s":0.027939,"completed_at":"2026-09-13T10:49:07.232Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2145gitlab # [ 241.372340] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.233Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"782bbc4806469c39c51496cc","created_at":"2026-09-13T10:49:05.839Z","trace_propagation_headers":{"sentry-trace":"928ab22e5fcc4963a58e9db6cbb57610-d0fe438dfa164433","baggage":"sentry-trace_id=928ab22e5fcc4963a58e9db6cbb57610,sentry-release=Unknown"},"correlation_id":"01M2D6519TATVGN8MSP6ZM9T63","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e10ec385e73206a0e2a55c6edc77ceb9915e575c0430ef53609678d6ea870618","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.841Z","job_size_bytes":467,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-782bbc4806469c39c51496cc: start","job_status":"start","queue_duration_s":1.391582,"scheduling_latency_s":1.391595}2146gitlab # [ 241.373038] gitaly[889]: time="2026-09-13T10:49:07.652Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=968 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-13T10:49:37.639" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:07.639" grpc.time_ms=12.767 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab # [ 241.373594] sidekiq-cluster[2474]: {"severity":"WARN","time":"2026-09-13T10:49:07.668Z","class":"CreatePipelineWorker","correlation_id":"01M2D6519TATVGN8MSP6ZM9T63","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"2011f83c42fa2923de0800d2cc9fee902911eb2d","after":"cdbccfdc22fdb0950698128f97da0717df0038d9","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"cdbccfdc22fdb0950698128f97da0717df0038d9","ref":"refs/heads/master"},"retry":0}2148gitlab # [ 241.374202] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.672Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"782bbc4806469c39c51496cc","created_at":"2026-09-13T10:49:05.839Z","trace_propagation_headers":{"sentry-trace":"928ab22e5fcc4963a58e9db6cbb57610-d0fe438dfa164433","baggage":"sentry-trace_id=928ab22e5fcc4963a58e9db6cbb57610,sentry-release=Unknown"},"correlation_id":"01M2D6519TATVGN8MSP6ZM9T63","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e10ec385e73206a0e2a55c6edc77ceb9915e575c0430ef53609678d6ea870618","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.841Z","job_size_bytes":467,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-782bbc4806469c39c51496cc: done: 0.438967 sec","job_status":"done","queue_duration_s":1.391582,"scheduling_latency_s":1.391595,"gitaly_calls":7,"gitaly_duration_s":0.041318,"redis_calls":33,"redis_duration_s":0.00285,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000354,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001294,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00058,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.38529,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.438967,"completed_at":"2026-09-13T10:49:07.672Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009601,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2149gitlab # [ 241.423730] gitaly[889]: time="2026-09-13T10:49:07.661Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D6519TATVGN8MSP6ZM9T63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-13T10:49:37.654" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:07.654" grpc.time_ms=7.038 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2150gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9'2151gitlab # [ 241.424792] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.673Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"acbea49e-8177-4b54-9f3f-361197f127f5\"}"],"class":"WebHookWorker","jid":"ce6fd3bff6548c7eececeee8","created_at":"2026-09-13T10:49:05.856Z","trace_propagation_headers":{"sentry-trace":"928ab22e5fcc4963a58e9db6cbb57610-d0fe438dfa164433","baggage":"sentry-trace_id=928ab22e5fcc4963a58e9db6cbb57610,sentry-release=Unknown"},"correlation_id":"01M2D6519TATVGN8MSP6ZM9T63","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:37bec3b003fe9c8f8457a6faea52c3c4cb4180ca2fa98956956a12092c32ebff","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.858Z","job_size_bytes":1749,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-ce6fd3bff6548c7eececeee8: start","job_status":"start","queue_duration_s":1.81486,"scheduling_latency_s":1.8149}2152gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9', in 0.04 seconds)2153gitlab # [ 241.469871] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.696Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"acbea49e-8177-4b54-9f3f-361197f127f5\"}"],"class":"WebHookWorker","jid":"ce6fd3bff6548c7eececeee8","created_at":"2026-09-13T10:49:05.856Z","trace_propagation_headers":{"sentry-trace":"928ab22e5fcc4963a58e9db6cbb57610-d0fe438dfa164433","baggage":"sentry-trace_id=928ab22e5fcc4963a58e9db6cbb57610,sentry-release=Unknown"},"correlation_id":"01M2D6519TATVGN8MSP6ZM9T63","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:37bec3b003fe9c8f8457a6faea52c3c4cb4180ca2fa98956956a12092c32ebff","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.858Z","job_size_bytes":1749,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-ce6fd3bff6548c7eececeee8: done: 0.023265 sec","job_status":"done","queue_duration_s":1.81486,"scheduling_latency_s":1.8149,"redis_calls":14,"redis_duration_s":0.001657,"redis_read_bytes":25,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.000198,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000467,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.0046656769999913195,"cpu_s":0.013949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.023265,"completed_at":"2026-09-13T10:49:07.696Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2154gitlab # [ 241.512776] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.697Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"4cccbf9a6cee0f394d1f77e1","created_at":"2026-09-13T10:49:05.944Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-ea4348f305514f33","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.948Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-4cccbf9a6cee0f394d1f77e1: start","job_status":"start","queue_duration_s":1.749638,"scheduling_latency_s":1.749652}2155gitlab # [ 241.513663] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.729Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"4cccbf9a6cee0f394d1f77e1","created_at":"2026-09-13T10:49:05.944Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-ea4348f305514f33","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:05.948Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-4cccbf9a6cee0f394d1f77e1: done: 0.03184 sec","job_status":"done","queue_duration_s":1.749638,"scheduling_latency_s":1.749652,"redis_calls":19,"redis_duration_s":0.002529,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000566,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000329,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001209,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.004904813,"duration_s":0.03184,"completed_at":"2026-09-13T10:49:07.729Z","load_balancing_strategy":"primary","db_duration_s":0.004404,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2156gitlab # [ 241.555959] nixbot[2593]: INFO: ::ffff:127.0.0.1:59820 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9 HTTP/1.1" 200 OK2157gitlab # [ 241.556679] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.730Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","232fdf8397138ca15b665783"],"class":"WebHooks::LogExecutionWorker","jid":"d0963ce9eabfe5681b00d187","created_at":"2026-09-13T10:49:06.842Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-b0bfc813a8f54590","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:15c3bf9c1d5041a40939acef800cf2a39904dfcfc6f525a664cc83fbcb97a99b","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:06.849Z","job_size_bytes":2591,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d0963ce9eabfe5681b00d187: start","job_status":"start","queue_duration_s":0.880832,"scheduling_latency_s":0.880845}2158gitlab # [ 241.557452] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.758Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","232fdf8397138ca15b665783"],"class":"WebHooks::LogExecutionWorker","jid":"d0963ce9eabfe5681b00d187","created_at":"2026-09-13T10:49:06.842Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-b0bfc813a8f54590","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:15c3bf9c1d5041a40939acef800cf2a39904dfcfc6f525a664cc83fbcb97a99b","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:06.849Z","job_size_bytes":2591,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d0963ce9eabfe5681b00d187: done: 0.027861 sec","job_status":"done","queue_duration_s":0.880832,"scheduling_latency_s":0.880845,"redis_calls":10,"redis_duration_s":0.0012850000000000001,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000208686,"duration_s":0.027861,"completed_at":"2026-09-13T10:49:07.758Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004756,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2159gitlab # [ 241.608872] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.759Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","ce6fd3bff6548c7eececeee8"],"class":"WebHooks::LogExecutionWorker","jid":"e12140d27fa6bb0dc942d7ca","created_at":"2026-09-13T10:49:07.691Z","trace_propagation_headers":{"sentry-trace":"928ab22e5fcc4963a58e9db6cbb57610-7298b24aa99f486f","baggage":"sentry-trace_id=928ab22e5fcc4963a58e9db6cbb57610,sentry-release=Unknown"},"correlation_id":"01M2D6519TATVGN8MSP6ZM9T63","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:25274902c2929327949d3dc13e56ed9fffcdf728c0c8cfd778ed2f5f8be14a97","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:07.693Z","job_size_bytes":2591,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-e12140d27fa6bb0dc942d7ca: start","job_status":"start","queue_duration_s":0.066019,"scheduling_latency_s":0.066032}2160gitlab # [ 241.609696] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.774Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","ce6fd3bff6548c7eececeee8"],"class":"WebHooks::LogExecutionWorker","jid":"e12140d27fa6bb0dc942d7ca","created_at":"2026-09-13T10:49:07.691Z","trace_propagation_headers":{"sentry-trace":"928ab22e5fcc4963a58e9db6cbb57610-7298b24aa99f486f","baggage":"sentry-trace_id=928ab22e5fcc4963a58e9db6cbb57610,sentry-release=Unknown"},"correlation_id":"01M2D6519TATVGN8MSP6ZM9T63","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:25274902c2929327949d3dc13e56ed9fffcdf728c0c8cfd778ed2f5f8be14a97","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:07.693Z","job_size_bytes":2591,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-e12140d27fa6bb0dc942d7ca: done: 0.014818 sec","job_status":"done","queue_duration_s":0.066019,"scheduling_latency_s":0.066032,"redis_calls":7,"redis_duration_s":0.000861,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014818,"completed_at":"2026-09-13T10:49:07.774Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002486,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2161gitlab # [ 241.663840] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.775Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"75fa8149e18824e728ccd1f1","created_at":"2026-09-13T10:49:07.720Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-11c500f44a72411f","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:07.724Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-75fa8149e18824e728ccd1f1: start","job_status":"start","queue_duration_s":0.051013,"scheduling_latency_s":0.051026}2162gitlab # [ 241.664569] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:07.826Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"75fa8149e18824e728ccd1f1","created_at":"2026-09-13T10:49:07.720Z","trace_propagation_headers":{"sentry-trace":"e392b2093b7040f5a51dd0a789113a6c-11c500f44a72411f","baggage":"sentry-trace_id=e392b2093b7040f5a51dd0a789113a6c,sentry-release=Unknown"},"correlation_id":"01M2D63PDW7DFE8M4NDRH8GYQW","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:07.724Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-75fa8149e18824e728ccd1f1: done: 0.05139 sec","job_status":"done","queue_duration_s":0.051013,"scheduling_latency_s":0.051026,"redis_calls":11,"redis_duration_s":0.0015669999999999998,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000394,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217067,"duration_s":0.05139,"completed_at":"2026-09-13T10:49:07.826Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2163gitlab # [ 241.758179] nixbot[2593]: {"ts": "2026-09-13T10:49:08.190Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2164gitlab # [ 241.806743] gitaly[889]: time="2026-09-13T10:49:08.238Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D656B4VCQAX0CQW6EQEB65 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:08.229" grpc.time_ms=9.234 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc2165gitlab # [ 241.820059] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 422166gitlab # [ 241.833778] gitaly[889]: time="2026-09-13T10:49:08.266Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:38.265" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:08.265" grpc.time_ms=0.514 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2167gitlab # [ 241.875081] gitaly[889]: time="2026-09-13T10:49:08.307Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2D656CYF738TD6E41J18CPW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:08.297" pid=889 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2168gitlab # [ 241.876115] gitaly[889]: time="2026-09-13T10:49:08.307Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656CYF738TD6E41J18CPW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:08.297" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc2169gitlab # [ 241.895965] gitaly[889]: time="2026-09-13T10:49:08.328Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656CYF738TD6E41J18CPW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:08.297" grpc.time_ms=10.252 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc2170gitlab # [ 241.896809] gitaly[889]: time="2026-09-13T10:49:08.328Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=22 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:49:18.202" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:08.302" grpc.time_ms=26.078 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2171gitlab # [ 241.897447] gitlab-workhorse[823]: time="2026-09-13T10:49:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672172gitlab # [ 241.897884] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 742173gitlab # [ 241.926541] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.358Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9556232f643e858c1df8ef76","created_at":"2026-09-13T10:49:08.353Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-96d271ee8e3d4867","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.356Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9556232f643e858c1df8ef76: start","job_status":"start","queue_duration_s":0.002561,"scheduling_latency_s":0.002591}2174gitlab # [ 241.948937] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2011f83c42fa2923de0800d2cc9fee902911eb2d HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1802175gitlab # [ 241.950856] nixbot[2593]: {"ts": "2026-09-13T10:49:08.383Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2011f83c42fa2923de0800d2cc9fee902911eb2d \"HTTP/1.1 201 Created\""}2176gitlab # [ 241.991599] gitaly[889]: time="2026-09-13T10:49:08.424Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2D656H3KXZVVH6KQ73MGE9T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:08.417" grpc.time_ms=6.385 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc2177gitlab # [ 242.003564] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 482178gitlab # [ 242.004310] gitaly[889]: time="2026-09-13T10:49:08.436Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656HB368FPZ0E4G98KZSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:38.435" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:08.435" grpc.time_ms=0.614 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2179gitlab # [ 242.021637] gitaly[889]: time="2026-09-13T10:49:08.454Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:08.453" grpc.time_ms=0.253 pid=889 span.kind=server system=grpc2180gitlab # [ 242.045422] gitaly[889]: time="2026-09-13T10:49:08.477Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D656HB368FPZ0E4G98KZSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:49:18.292" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:08.472" grpc.time_ms=5.079 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2181gitlab # [ 242.053068] gitaly[889]: time="2026-09-13T10:49:08.485Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3888 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:08.483" grpc.time_ms=1.563 pid=889 span.kind=server system=grpc2182gitlab # [ 242.076161] gitaly[889]: time="2026-09-13T10:49:08.508Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2D656K387P2B0E2DQCKCBGH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:08.495" pid=889 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2183gitlab # [ 242.076760] gitaly[889]: time="2026-09-13T10:49:08.508Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656K387P2B0E2DQCKCBGH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:08.495" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc2184gitlab # [ 242.077467] gitaly[889]: time="2026-09-13T10:49:08.508Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656K387P2B0E2DQCKCBGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:08.495" grpc.time_ms=12.961 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc2185gitlab # [ 242.078098] gitlab-workhorse[823]: time="2026-09-13T10:49:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162186gitlab # [ 242.078503] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 572187gitlab # [ 242.103280] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2011f83c42fa2923de0800d2cc9fee902911eb2d HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1402188gitlab # [ 242.116844] nixbot[2593]: {"ts": "2026-09-13T10:49:08.549Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2011f83c42fa2923de0800d2cc9fee902911eb2d \"HTTP/1.1 201 Created\""}2189gitlab # [ 242.119527] gitaly[889]: time="2026-09-13T10:49:08.551Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:08.551" grpc.time_ms=0.279 pid=889 span.kind=server system=grpc2190gitlab # [ 242.137038] gitaly[889]: time="2026-09-13T10:49:08.568Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 diskcache=07fdc8ea-689c-40de-85bd-9a769a5c93e3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T10:49:38.429" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:08.429" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2191gitlab # [ 242.145978] gitaly[889]: time="2026-09-13T10:49:08.569Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=73 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7286 command.oublock=0 command.real_time_ms=132 command.spawn_token_fork_ms=0 command.system_time_ms=48 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T10:49:38.429" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:08.429" grpc.time_ms=139.257 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2192gitlab # [ 242.172502] gitaly[889]: time="2026-09-13T10:49:08.604Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656PC6TFB6EZKTJEZ9T0Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:38.603" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:08.604" grpc.time_ms=0.759 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2193gitlab # [ 242.178094] gitaly[889]: time="2026-09-13T10:49:08.610Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-13T10:49:38.609" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:08.609" grpc.time_ms=0.588 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2194gitlab # [ 242.197558] gitaly[889]: time="2026-09-13T10:49:08.630Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656QCZ3Q25V9XG1NY30R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:38.329" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:08.629" grpc.time_ms=0.467 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2195gitlab # [ 242.200760] gitaly[889]: time="2026-09-13T10:49:08.633Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:38.632" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:08.632" grpc.time_ms=0.613 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2196gitlab # [ 242.224429] gitaly[889]: time="2026-09-13T10:49:08.656Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2D656PC6TFB6EZKTJEZ9T0Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:49:18.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:08.650" grpc.time_ms=5.632 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2197gitlab # [ 242.236245] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.667Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a6c1a41f19406843ccaa6912","created_at":"2026-09-13T10:49:08.665Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"9556232f643e858c1df8ef76","job_size_bytes":3,"pid":2474,"job_status":"deduplicated","message":"PipelineProcessWorker JID-a6c1a41f19406843ccaa6912: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2198gitlab # [ 242.249923] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.670Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9556232f643e858c1df8ef76","created_at":"2026-09-13T10:49:08.353Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-96d271ee8e3d4867","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.356Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2474,"job_status":"rescheduled","message":"PipelineProcessWorker JID-9556232f643e858c1df8ef76: rescheduled"}2199gitlab # [ 242.262969] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.676Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9556232f643e858c1df8ef76","created_at":"2026-09-13T10:49:08.353Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-96d271ee8e3d4867","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.356Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9556232f643e858c1df8ef76: done: 0.317969 sec","job_status":"done","queue_duration_s":0.002561,"scheduling_latency_s":0.002591,"gitaly_calls":3,"gitaly_duration_s":0.147445,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.012775,"redis_read_bytes":226,"redis_write_bytes":18469,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000325,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000581,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003552,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12315,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.005575,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000177,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000676,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001564,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":18,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105383,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.237605617,"duration_s":0.317969,"completed_at":"2026-09-13T10:49:08.676Z","load_balancing_strategy":"primary","db_duration_s":0.039195,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2200gitlab # [ 242.308963] gitaly[889]: time="2026-09-13T10:49:08.674Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D656QCZ3Q25V9XG1NY30R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-13T10:49:38.367" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:08.667" grpc.time_ms=5.742 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2201gitlab # [ 242.321773] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/2011f83c42fa2923de0800d2cc9fee902911eb2d HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1392202gitlab # [ 242.322757] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.677Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8989d22702da313dd30fa64f","created_at":"2026-09-13T10:49:08.424Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.425Z","job_size_bytes":23,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8989d22702da313dd30fa64f: start","job_status":"start","queue_duration_s":0.251748,"scheduling_latency_s":0.251765}2203gitlab # [ 242.323576] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.710Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8989d22702da313dd30fa64f","created_at":"2026-09-13T10:49:08.424Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.425Z","job_size_bytes":23,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8989d22702da313dd30fa64f: done: 0.032439 sec","job_status":"done","queue_duration_s":0.251748,"scheduling_latency_s":0.251765,"redis_calls":7,"redis_duration_s":0.001037,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000788,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032439,"completed_at":"2026-09-13T10:49:08.710Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007244,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2204gitlab # [ 242.371407] nixbot[2593]: {"ts": "2026-09-13T10:49:08.696Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/2011f83c42fa2923de0800d2cc9fee902911eb2d \"HTTP/1.1 201 Created\""}2205gitlab # [ 242.372076] gitaly[889]: time="2026-09-13T10:49:08.687Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D656QCZ3Q25V9XG1NY30R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:49:18.072" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:08.682" grpc.time_ms=5.451 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2206gitlab # [ 242.372722] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.711Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"c7cf0820359dc4e22b948ddb","created_at":"2026-09-13T10:49:08.573Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.575Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-c7cf0820359dc4e22b948ddb: start","job_status":"start","queue_duration_s":0.135342,"scheduling_latency_s":0.135357}2207gitlab # [ 242.373810] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.728Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"c7cf0820359dc4e22b948ddb","created_at":"2026-09-13T10:49:08.573Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.575Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-c7cf0820359dc4e22b948ddb: done: 0.017311 sec","job_status":"done","queue_duration_s":0.135342,"scheduling_latency_s":0.135357,"redis_calls":7,"redis_duration_s":0.001033,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000754,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017311,"completed_at":"2026-09-13T10:49:08.728Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2208gitlab # [ 242.423208] gitaly[889]: time="2026-09-13T10:49:08.757Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2D656QCZ3Q25V9XG1NY30R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-13T10:49:18.146" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:49:08.757" grpc.time_ms=0.133 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2209gitlab # [ 242.424028] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.729Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0f0c984448352cd178536361","created_at":"2026-09-13T10:49:08.581Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.584Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0f0c984448352cd178536361: start","job_status":"start","queue_duration_s":0.145235,"scheduling_latency_s":0.145248}2210gitlab # [ 242.462032] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.746Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0f0c984448352cd178536361","created_at":"2026-09-13T10:49:08.581Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.584Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0f0c984448352cd178536361: done: 0.016977 sec","job_status":"done","queue_duration_s":0.145235,"scheduling_latency_s":0.145248,"redis_calls":7,"redis_duration_s":0.001351,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016977,"completed_at":"2026-09-13T10:49:08.746Z","load_balancing_strategy":"primary","db_duration_s":0.002705,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2211gitlab # [ 242.463090] gitaly[889]: time="2026-09-13T10:49:08.765Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=619 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656QCZ3Q25V9XG1NY30R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-13T10:49:18.149" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:08.759" grpc.time_ms=6.525 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2212gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9'2213gitlab # [ 242.506850] gitaly[889]: time="2026-09-13T10:49:08.794Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D656QCZ3Q25V9XG1NY30R4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4146 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:08.794" grpc.time_ms=0.233 pid=889 span.kind=server system=grpc2214gitlab # [ 242.514736] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.747Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"54ef7adeb18d374f7e3c7a0d","created_at":"2026-09-13T10:49:08.591Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.592Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-54ef7adeb18d374f7e3c7a0d: start","job_status":"start","queue_duration_s":0.154865,"scheduling_latency_s":0.154878}2215gitlab # [ 242.515451] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.773Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"54ef7adeb18d374f7e3c7a0d","created_at":"2026-09-13T10:49:08.591Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.592Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-54ef7adeb18d374f7e3c7a0d: done: 0.025795 sec","job_status":"done","queue_duration_s":0.154865,"scheduling_latency_s":0.154878,"redis_calls":10,"redis_duration_s":0.001494,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000457,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025795,"completed_at":"2026-09-13T10:49:08.773Z","load_balancing_strategy":"primary","db_duration_s":0.003772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2216gitlab # [ 242.563483] nixbot[2593]: {"ts": "2026-09-13T10:49:08.939Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cdbccfdc22fdb0950698128f97da0717df0038d9 \"HTTP/1.1 201 Created\""}2217gitlab # [ 242.564117] nixbot[2593]: {"ts": "2026-09-13T10:49:08.946Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-cdbccfdc22fd-4"}2218gitlab # [ 242.564547] gitaly[889]: time="2026-09-13T10:49:08.816Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=60 command.spawn_token_fork_ms=58 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D656VDVB0ZGKJV0A9T8ZV8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:08.754" grpc.time_ms=61.898 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc2219gitlab # [ 242.565219] gitaly[889]: time="2026-09-13T10:49:08.837Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D656QCZ3Q25V9XG1NY30R4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:08.836" grpc.time_ms=0.229 pid=889 span.kind=server system=grpc2220gitlab # [ 242.565855] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cdbccfdc22fdb0950698128f97da0717df0038d9 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 3492221gitlab # [ 242.567352] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 2212222gitlab # [ 242.569079] gitlab-workhorse[823]: time="2026-09-13T10:49:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672223gitlab # [ 242.570673] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 462224gitlab # [ 242.572616] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.774Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"16dea18bd8533bd7e0a993ac","created_at":"2026-09-13T10:49:08.592Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.593Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-16dea18bd8533bd7e0a993ac: start","job_status":"start","queue_duration_s":0.180476,"scheduling_latency_s":0.180494}2225gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9', in 0.13 seconds)2226(finished: subtest: push delivers the webhook, in 46.77 seconds)2227subtest: eval and build post commit statuses2228gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses2229gitlab # [ 242.587256] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.793Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"16dea18bd8533bd7e0a993ac","created_at":"2026-09-13T10:49:08.592Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.593Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-16dea18bd8533bd7e0a993ac: done: 0.01948 sec","job_status":"done","queue_duration_s":0.180476,"scheduling_latency_s":0.180494,"redis_calls":7,"redis_duration_s":0.000968,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000718,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01948,"completed_at":"2026-09-13T10:49:08.793Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003873,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2230gitlab # [ 242.629652] gitaly[889]: time="2026-09-13T10:49:08.846Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2D656QCZ3Q25V9XG1NY30R4 diskcache=9c73bb27-577e-4f35-a99c-9ed9009d7447 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-13T10:49:18.156" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:49:08.767" pid=889 ref=refs/keep-around/cdbccfdc22fdb0950698128f97da0717df0038d9 remote_ip="2001:db8:1::1" revision=cdbccfdc22fdb0950698128f97da0717df0038d9 span.kind=server system=grpc username=root2231gitlab # [ 242.634574] nixbot[2593]: INFO: ::ffff:127.0.0.1:59834 - "GET /api/repos/gitlab/root/test-flake/builds?commit=cdbccfdc22fdb0950698128f97da0717df0038d9 HTTP/1.1" 200 OK2232gitlab # [ 242.637126] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.794Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"de632c58d382fdfddc27176e","created_at":"2026-09-13T10:49:08.593Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.595Z","job_size_bytes":19,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-de632c58d382fdfddc27176e: start","job_status":"start","queue_duration_s":0.19954,"scheduling_latency_s":0.199556}2233gitlab # [ 242.650674] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.819Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"de632c58d382fdfddc27176e","created_at":"2026-09-13T10:49:08.593Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.595Z","job_size_bytes":19,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-de632c58d382fdfddc27176e: done: 0.024492 sec","job_status":"done","queue_duration_s":0.19954,"scheduling_latency_s":0.199556,"redis_calls":8,"redis_duration_s":0.005464,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005058,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024492,"completed_at":"2026-09-13T10:49:08.819Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00436,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2234gitlab # [ 242.697318] gitaly[889]: time="2026-09-13T10:49:08.846Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=49 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5446 command.oublock=8 command.real_time_ms=72 command.spawn_token_fork_ms=0 command.system_time_ms=37 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656QCZ3Q25V9XG1NY30R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-13T10:49:18.156" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T10:49:08.767" grpc.time_ms=79.52 pid=889 ref=refs/keep-around/cdbccfdc22fdb0950698128f97da0717df0038d9 remote_ip="2001:db8:1::1" revision=cdbccfdc22fdb0950698128f97da0717df0038d9 span.kind=server system=grpc username=root2235gitlab # [ 242.700112] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.820Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a02750804d6b4c2e28a2b29a","created_at":"2026-09-13T10:49:08.595Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.596Z","job_size_bytes":66,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a02750804d6b4c2e28a2b29a: start","job_status":"start","queue_duration_s":0.223364,"scheduling_latency_s":0.223379}2236gitlab # [ 242.715470] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.833Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a02750804d6b4c2e28a2b29a","created_at":"2026-09-13T10:49:08.595Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.596Z","job_size_bytes":66,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a02750804d6b4c2e28a2b29a: done: 0.013413 sec","job_status":"done","queue_duration_s":0.223364,"scheduling_latency_s":0.223379,"redis_calls":7,"redis_duration_s":0.0008539999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00062,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013413,"completed_at":"2026-09-13T10:49:08.833Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001506,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2237gitlab # [ 242.759279] gitaly[889]: time="2026-09-13T10:49:08.849Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656QCZ3Q25V9XG1NY30R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:38.549" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:08.849" grpc.time_ms=0.256 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2238gitlab # [ 242.764236] gitaly[889]: time="2026-09-13T10:49:08.948Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:08.948" grpc.time_ms=0.328 pid=889 span.kind=server system=grpc2239gitlab # [ 242.772839] nixbot[2593]: {"ts": "2026-09-13T10:49:09.158Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-cdbccfdc22fd-4", "argv0": "bwrap"}2240gitlab # [ 242.774880] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.834Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"8962b97626f3dc95ea1d5505","created_at":"2026-09-13T10:49:08.597Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.597Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-8962b97626f3dc95ea1d5505: start","job_status":"start","queue_duration_s":0.236471,"scheduling_latency_s":0.236484}2241gitlab # [ 242.818305] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.850Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"8962b97626f3dc95ea1d5505","created_at":"2026-09-13T10:49:08.597Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.597Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-8962b97626f3dc95ea1d5505: done: 0.016412 sec","job_status":"done","queue_duration_s":0.236471,"scheduling_latency_s":0.236484,"redis_calls":7,"redis_duration_s":0.001063,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00081,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016412,"completed_at":"2026-09-13T10:49:08.850Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00381,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2242gitlab # [ 242.826416] gitaly[889]: time="2026-09-13T10:49:08.966Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3888 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:08.965" grpc.time_ms=0.361 pid=889 span.kind=server system=grpc2243gitlab # [ 242.870628] gitaly[889]: time="2026-09-13T10:49:08.986Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2D6572DPQNAWTK3SKBRNCKT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:08.979" pid=889 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2244gitlab # [ 242.871229] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.851Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"16c6b2c3613a79df6a410a4f","created_at":"2026-09-13T10:49:08.598Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.599Z","job_size_bytes":6,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-16c6b2c3613a79df6a410a4f: start","job_status":"start","queue_duration_s":0.252499,"scheduling_latency_s":0.252511}2245gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses, in 0.26 seconds)2246gitlab # [ 242.871845] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.865Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"16c6b2c3613a79df6a410a4f","created_at":"2026-09-13T10:49:08.598Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.599Z","job_size_bytes":6,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-16c6b2c3613a79df6a410a4f: done: 0.013385 sec","job_status":"done","queue_duration_s":0.252499,"scheduling_latency_s":0.252511,"redis_calls":7,"redis_duration_s":0.003427,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003097,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00033,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013385,"completed_at":"2026-09-13T10:49:08.865Z","load_balancing_strategy":"primary","db_duration_s":0.000329,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2247gitlab # [ 242.910213] gitaly[889]: time="2026-09-13T10:49:08.986Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2D6572DPQNAWTK3SKBRNCKT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:08.979" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc2248gitlab # [ 242.911287] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2362249gitlab # [ 242.911741] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.866Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d9bdc5f4fba4e22c057f4659","created_at":"2026-09-13T10:49:08.599Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.600Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d9bdc5f4fba4e22c057f4659: start","job_status":"start","queue_duration_s":0.265674,"scheduling_latency_s":0.265693}2250gitlab # [ 242.956852] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.880Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d9bdc5f4fba4e22c057f4659","created_at":"2026-09-13T10:49:08.599Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.600Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d9bdc5f4fba4e22c057f4659: done: 0.014073 sec","job_status":"done","queue_duration_s":0.265674,"scheduling_latency_s":0.265693,"redis_calls":7,"redis_duration_s":0.0008849999999999999,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000637,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009513,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014073,"completed_at":"2026-09-13T10:49:08.880Z","load_balancing_strategy":"primary","db_duration_s":0.001844,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2251gitlab # [ 242.957742] gitaly[889]: time="2026-09-13T10:49:08.986Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2D6572DPQNAWTK3SKBRNCKT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T10:49:08.979" grpc.time_ms=6.748 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc2252gitlab # [ 242.968782] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:08.881Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"6dce47e6af5a0062c998d4aa","created_at":"2026-09-13T10:49:08.670Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.672Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6dce47e6af5a0062c998d4aa: start","job_status":"start","queue_duration_s":0.209121,"scheduling_latency_s":0.209208}2253gitlab # [ 243.013214] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.365Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"6dce47e6af5a0062c998d4aa","created_at":"2026-09-13T10:49:08.670Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.672Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2474,"job_status":"rescheduled","message":"PipelineProcessWorker JID-6dce47e6af5a0062c998d4aa: rescheduled"}2254gitlab # [ 243.013970] gitaly[889]: time="2026-09-13T10:49:08.993Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T10:49:08.992" grpc.time_ms=0.855 pid=889 span.kind=server system=grpc2255gitlab # [ 243.014498] gitaly[889]: time="2026-09-13T10:49:09.076Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T10:49:38.624" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:08.924" operations="[repack_refs]" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2256gitlab # [ 243.015227] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.369Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"6dce47e6af5a0062c998d4aa","created_at":"2026-09-13T10:49:08.670Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-6e0ee0557afa4a15","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.672Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6dce47e6af5a0062c998d4aa: done: 0.488536 sec","job_status":"done","queue_duration_s":0.209121,"scheduling_latency_s":0.209208,"gitaly_calls":3,"gitaly_duration_s":0.313744,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.07838,"redis_read_bytes":149,"redis_write_bytes":18015,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000313,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000511,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002837,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.071327,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000146,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000677,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002256,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07914,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.465820936,"duration_s":0.488536,"completed_at":"2026-09-13T10:49:09.369Z","load_balancing_strategy":"primary","db_duration_s":0.020954,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2257gitlab # [ 243.062593] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.370Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1c02c1a092f8605637863efc","created_at":"2026-09-13T10:49:08.851Z","trace_propagation_headers":{"sentry-trace":"6daf36719cd84e9d9cc959be5e1e6819-5fa3153d9b7043a0","baggage":"sentry-trace_id=6daf36719cd84e9d9cc959be5e1e6819,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D656QCZ3Q25V9XG1NY30R4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.853Z","job_size_bytes":65,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1c02c1a092f8605637863efc: start","job_status":"start","queue_duration_s":0.517243,"scheduling_latency_s":0.517258}2258gitlab # [ 243.072568] gitaly[889]: time="2026-09-13T10:49:09.077Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T10:49:38.624" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:08.924" pid=889 remote_ip="2001:db8:1::1" repository_info="{false {6 701 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-13 10:48:12.569924788 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2259gitlab # [ 243.115689] gitaly[889]: time="2026-09-13T10:49:09.157Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 diskcache=e2664e65-34f6-4290-9921-31af823ea369 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T10:49:38.624" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:08.924" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2260gitlab # [ 243.116400] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.387Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1c02c1a092f8605637863efc","created_at":"2026-09-13T10:49:08.851Z","trace_propagation_headers":{"sentry-trace":"6daf36719cd84e9d9cc959be5e1e6819-5fa3153d9b7043a0","baggage":"sentry-trace_id=6daf36719cd84e9d9cc959be5e1e6819,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D656QCZ3Q25V9XG1NY30R4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.853Z","job_size_bytes":65,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1c02c1a092f8605637863efc: done: 0.016633 sec","job_status":"done","queue_duration_s":0.517243,"scheduling_latency_s":0.517258,"redis_calls":7,"redis_duration_s":0.0009480000000000001,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000655,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016633,"completed_at":"2026-09-13T10:49:09.387Z","load_balancing_strategy":"primary","db_duration_s":0.002588,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2261gitlab # [ 243.153959] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.388Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"f6dc2bf092b0986f3d0d95f1","created_at":"2026-09-13T10:49:08.854Z","trace_propagation_headers":{"sentry-trace":"6daf36719cd84e9d9cc959be5e1e6819-5fa3153d9b7043a0","baggage":"sentry-trace_id=6daf36719cd84e9d9cc959be5e1e6819,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D656QCZ3Q25V9XG1NY30R4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.855Z","job_size_bytes":65,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-f6dc2bf092b0986f3d0d95f1: start","job_status":"start","queue_duration_s":0.53304,"scheduling_latency_s":0.533053}2262gitlab # [ 243.154797] gitaly[889]: time="2026-09-13T10:49:09.157Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=138 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7218 command.oublock=0 command.real_time_ms=154 command.spawn_token_fork_ms=73 command.system_time_ms=112 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T10:49:38.624" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:08.924" grpc.time_ms=232.749 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2263gitlab # [ 243.155479] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.417Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"f6dc2bf092b0986f3d0d95f1","created_at":"2026-09-13T10:49:08.854Z","trace_propagation_headers":{"sentry-trace":"6daf36719cd84e9d9cc959be5e1e6819-5fa3153d9b7043a0","baggage":"sentry-trace_id=6daf36719cd84e9d9cc959be5e1e6819,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D656QCZ3Q25V9XG1NY30R4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.855Z","job_size_bytes":65,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-f6dc2bf092b0986f3d0d95f1: done: 0.029601 sec","job_status":"done","queue_duration_s":0.53304,"scheduling_latency_s":0.533053,"redis_calls":10,"redis_duration_s":0.001276,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000682,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000594,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029601,"completed_at":"2026-09-13T10:49:09.417Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007286,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2264gitlab # [ 243.228778] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.418Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"61f3431121688b133b7f9d99","created_at":"2026-09-13T10:49:08.887Z","trace_propagation_headers":{"sentry-trace":"6daf36719cd84e9d9cc959be5e1e6819-5fa3153d9b7043a0","baggage":"sentry-trace_id=6daf36719cd84e9d9cc959be5e1e6819,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D656QCZ3Q25V9XG1NY30R4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.889Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-61f3431121688b133b7f9d99: start","job_status":"start","queue_duration_s":0.528837,"scheduling_latency_s":0.528851}2265gitlab # [ 243.229900] gitaly[889]: time="2026-09-13T10:49:09.243Z" level=info msg="finished unary call with code OK" catfile.duration_ms=87 catfile.flush_count=1 catfile.flush_ms=86 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D65778PVQS189BXRGK5H93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:39.154" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:09.155" grpc.time_ms=88.657 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2266gitlab # [ 243.230473] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.491Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"61f3431121688b133b7f9d99","created_at":"2026-09-13T10:49:08.887Z","trace_propagation_headers":{"sentry-trace":"6daf36719cd84e9d9cc959be5e1e6819-5fa3153d9b7043a0","baggage":"sentry-trace_id=6daf36719cd84e9d9cc959be5e1e6819,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2D656QCZ3Q25V9XG1NY30R4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.889Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-61f3431121688b133b7f9d99: done: 0.072748 sec","job_status":"done","queue_duration_s":0.528837,"scheduling_latency_s":0.528851,"gitaly_calls":2,"gitaly_duration_s":0.004588,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.003978,"redis_read_bytes":80,"redis_write_bytes":5120,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000601,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000655,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000179,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1131,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000168,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000273,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052255,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.055319322,"duration_s":0.072748,"completed_at":"2026-09-13T10:49:09.491Z","load_balancing_strategy":"primary","db_duration_s":0.015805,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2267gitlab # [ 243.262842] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.492Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"78bce2bd76d39a9887613c74","created_at":"2026-09-13T10:49:08.919Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.921Z","job_size_bytes":23,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-78bce2bd76d39a9887613c74: start","job_status":"start","queue_duration_s":0.571163,"scheduling_latency_s":0.571177}2268gitlab # [ 243.308845] gitaly[889]: time="2026-09-13T10:49:09.243Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T10:49:38.624" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:08.924" pid=889 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2269gitlab # [ 243.309677] gitaly[889]: time="2026-09-13T10:49:09.244Z" level=info msg="optimized repository" clean_stale_data_time=165.830573ms clean_work_trees_time="87.72µs" commit_graph_time="3.352µs" correlation_id=01M2D656B8FQB6WXCM0633E1C5 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="4.47µs" pid=889 prune_time="3.073µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="3.911µs" storage_name=default system=housekeeping total_time=166.053507ms2270gitlab # [ 243.310165] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.516Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"78bce2bd76d39a9887613c74","created_at":"2026-09-13T10:49:08.919Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:08.921Z","job_size_bytes":23,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-78bce2bd76d39a9887613c74: done: 0.024047 sec","job_status":"done","queue_duration_s":0.571163,"scheduling_latency_s":0.571177,"redis_calls":7,"redis_duration_s":0.000928,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024047,"completed_at":"2026-09-13T10:49:09.516Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004767,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2271gitlab # [ 243.356152] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.517Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bdd63da9969315ee15b5470d","created_at":"2026-09-13T10:49:09.236Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.238Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bdd63da9969315ee15b5470d: start","job_status":"start","queue_duration_s":0.279038,"scheduling_latency_s":0.279053}2272gitlab # [ 243.356786] gitaly[889]: time="2026-09-13T10:49:09.244Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T10:49:38.624" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:08.924" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2273gitlab # [ 243.357470] gitaly[889]: time="2026-09-13T10:49:09.341Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-13T10:49:39.340" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:09.340" grpc.time_ms=0.687 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2274gitlab # [ 243.396680] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.532Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bdd63da9969315ee15b5470d","created_at":"2026-09-13T10:49:09.236Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.238Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bdd63da9969315ee15b5470d: done: 0.014889 sec","job_status":"done","queue_duration_s":0.279038,"scheduling_latency_s":0.279053,"redis_calls":7,"redis_duration_s":0.00091,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014889,"completed_at":"2026-09-13T10:49:09.532Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002288,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2275gitlab # [ 243.400723] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.533Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d26585c6738b059a5f636f14","created_at":"2026-09-13T10:49:09.243Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.313Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d26585c6738b059a5f636f14: start","job_status":"start","queue_duration_s":0.219979,"scheduling_latency_s":0.219992}2276gitlab # [ 243.414724] gitaly[889]: time="2026-09-13T10:49:09.361Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656B8FQB6WXCM0633E1C5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:39.360" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:09.360" grpc.time_ms=0.518 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2277gitlab # [ 243.425866] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.548Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d26585c6738b059a5f636f14","created_at":"2026-09-13T10:49:09.243Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.313Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d26585c6738b059a5f636f14: done: 0.015431 sec","job_status":"done","queue_duration_s":0.219979,"scheduling_latency_s":0.219992,"redis_calls":7,"redis_duration_s":0.00092,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015431,"completed_at":"2026-09-13T10:49:09.548Z","load_balancing_strategy":"primary","db_duration_s":0.002576,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2278gitlab # [ 243.470988] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.549Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1e840963bea9f17ca895cf93","created_at":"2026-09-13T10:49:09.319Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.320Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1e840963bea9f17ca895cf93: start","job_status":"start","queue_duration_s":0.228558,"scheduling_latency_s":0.228571}2279gitlab # [ 243.475756] gitaly[889]: time="2026-09-13T10:49:09.461Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D656QCZ3Q25V9XG1NY30R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-13T10:49:39.460" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:09.460" grpc.time_ms=0.628 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2280gitlab # [ 243.487125] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.566Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1e840963bea9f17ca895cf93","created_at":"2026-09-13T10:49:09.319Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.320Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1e840963bea9f17ca895cf93: done: 0.016872 sec","job_status":"done","queue_duration_s":0.228558,"scheduling_latency_s":0.228571,"redis_calls":10,"redis_duration_s":0.001245,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000634,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000351,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016872,"completed_at":"2026-09-13T10:49:09.566Z","load_balancing_strategy":"primary","db_duration_s":0.002492,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2281gitlab # [ 243.550483] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.567Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"40c71cc7033c4e8b5a7e3036","created_at":"2026-09-13T10:49:09.321Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.322Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-40c71cc7033c4e8b5a7e3036: start","job_status":"start","queue_duration_s":0.244652,"scheduling_latency_s":0.244665}2282gitlab # [ 243.551233] gitaly[889]: time="2026-09-13T10:49:09.484Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D656QCZ3Q25V9XG1NY30R4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:39.483" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:09.484" grpc.time_ms=0.486 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2283gitlab # [ 243.551875] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.581Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"40c71cc7033c4e8b5a7e3036","created_at":"2026-09-13T10:49:09.321Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.322Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-40c71cc7033c4e8b5a7e3036: done: 0.014059 sec","job_status":"done","queue_duration_s":0.244652,"scheduling_latency_s":0.244665,"redis_calls":7,"redis_duration_s":0.000897,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014059,"completed_at":"2026-09-13T10:49:09.581Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2284gitlab # [ 243.614584] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.582Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"14b1eb0e399dfd06ac96d5c0","created_at":"2026-09-13T10:49:09.322Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.325Z","job_size_bytes":19,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-14b1eb0e399dfd06ac96d5c0: start","job_status":"start","queue_duration_s":0.256515,"scheduling_latency_s":0.256528}2285gitlab # [ 243.615264] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.595Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"14b1eb0e399dfd06ac96d5c0","created_at":"2026-09-13T10:49:09.322Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.325Z","job_size_bytes":19,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-14b1eb0e399dfd06ac96d5c0: done: 0.013677 sec","job_status":"done","queue_duration_s":0.256515,"scheduling_latency_s":0.256528,"redis_calls":8,"redis_duration_s":0.001172,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013677,"completed_at":"2026-09-13T10:49:09.595Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2286gitlab # [ 243.638464] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.596Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5e7b2f618f1f001cca7fd2c5","created_at":"2026-09-13T10:49:09.326Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.327Z","job_size_bytes":66,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5e7b2f618f1f001cca7fd2c5: start","job_status":"start","queue_duration_s":0.269003,"scheduling_latency_s":0.269016}2287gitlab # [ 243.653887] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.608Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5e7b2f618f1f001cca7fd2c5","created_at":"2026-09-13T10:49:09.326Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.327Z","job_size_bytes":66,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5e7b2f618f1f001cca7fd2c5: done: 0.012339 sec","job_status":"done","queue_duration_s":0.269003,"scheduling_latency_s":0.269016,"redis_calls":7,"redis_duration_s":0.000889,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012339,"completed_at":"2026-09-13T10:49:09.608Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001507,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2288gitlab # [ 243.692240] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.609Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"ae8f6d69c46ca1277ab189c0","created_at":"2026-09-13T10:49:09.327Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.328Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-ae8f6d69c46ca1277ab189c0: start","job_status":"start","queue_duration_s":0.280875,"scheduling_latency_s":0.280887}2289gitlab # [ 243.706123] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.624Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"ae8f6d69c46ca1277ab189c0","created_at":"2026-09-13T10:49:09.327Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.328Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-ae8f6d69c46ca1277ab189c0: done: 0.014753 sec","job_status":"done","queue_duration_s":0.280875,"scheduling_latency_s":0.280887,"redis_calls":7,"redis_duration_s":0.000874,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014753,"completed_at":"2026-09-13T10:49:09.624Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003265,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2290gitlab # [ 243.748065] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.625Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d373fcbad4cd3422b9213d92","created_at":"2026-09-13T10:49:09.329Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.330Z","job_size_bytes":6,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d373fcbad4cd3422b9213d92: start","job_status":"start","queue_duration_s":0.295183,"scheduling_latency_s":0.295197}2291gitlab # [ 243.787335] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.633Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"d373fcbad4cd3422b9213d92","created_at":"2026-09-13T10:49:09.329Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.330Z","job_size_bytes":6,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-d373fcbad4cd3422b9213d92: done: 0.008061 sec","job_status":"done","queue_duration_s":0.295183,"scheduling_latency_s":0.295197,"redis_calls":7,"redis_duration_s":0.000876,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008061,"completed_at":"2026-09-13T10:49:09.633Z","load_balancing_strategy":"primary","db_duration_s":0.000241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2292gitlab # [ 243.792262] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.634Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"f4a5ef5404cc77e5bcb94e88","created_at":"2026-09-13T10:49:09.330Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.331Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f4a5ef5404cc77e5bcb94e88: start","job_status":"start","queue_duration_s":0.302743,"scheduling_latency_s":0.302756}2293gitlab # [ 243.831803] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.646Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"f4a5ef5404cc77e5bcb94e88","created_at":"2026-09-13T10:49:09.330Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.331Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f4a5ef5404cc77e5bcb94e88: done: 0.012739 sec","job_status":"done","queue_duration_s":0.302743,"scheduling_latency_s":0.302756,"redis_calls":7,"redis_duration_s":0.000914,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012739,"completed_at":"2026-09-13T10:49:09.646Z","load_balancing_strategy":"primary","db_duration_s":0.001764,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2294gitlab # [ 243.841489] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.647Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"1092d068147cd4c563ad936c","created_at":"2026-09-13T10:49:09.365Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.366Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-1092d068147cd4c563ad936c: start","job_status":"start","queue_duration_s":0.281201,"scheduling_latency_s":0.281215}2295gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses2296gitlab # [ 243.855594] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.666Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"1092d068147cd4c563ad936c","created_at":"2026-09-13T10:49:09.365Z","trace_propagation_headers":{"sentry-trace":"8657ac1030264c479a6b4bd0c0a9555d-0d25a184575e4175","baggage":"sentry-trace_id=8657ac1030264c479a6b4bd0c0a9555d,sentry-release=Unknown"},"correlation_id":"01M2D656B8FQB6WXCM0633E1C5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.366Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-1092d068147cd4c563ad936c: done: 0.018141 sec","job_status":"done","queue_duration_s":0.281201,"scheduling_latency_s":0.281215,"redis_calls":8,"redis_duration_s":0.0049429999999999995,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004709,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018141,"completed_at":"2026-09-13T10:49:09.666Z","load_balancing_strategy":"primary","db_duration_s":0.001987,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2297gitlab # [ 243.910996] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.667Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c30282847dc996d8e4144eb8","created_at":"2026-09-13T10:49:09.451Z","trace_propagation_headers":{"sentry-trace":"6daf36719cd84e9d9cc959be5e1e6819-1dd03df2f6944185","baggage":"sentry-trace_id=6daf36719cd84e9d9cc959be5e1e6819,sentry-release=Unknown"},"correlation_id":"01M2D656QCZ3Q25V9XG1NY30R4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.452Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c30282847dc996d8e4144eb8: start","job_status":"start","queue_duration_s":0.215368,"scheduling_latency_s":0.215397}2298gitlab # [ 243.911668] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:09.690Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c30282847dc996d8e4144eb8","created_at":"2026-09-13T10:49:09.451Z","trace_propagation_headers":{"sentry-trace":"6daf36719cd84e9d9cc959be5e1e6819-1dd03df2f6944185","baggage":"sentry-trace_id=6daf36719cd84e9d9cc959be5e1e6819,sentry-release=Unknown"},"correlation_id":"01M2D656QCZ3Q25V9XG1NY30R4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:09.452Z","job_size_bytes":3,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c30282847dc996d8e4144eb8: done: 0.023029 sec","job_status":"done","queue_duration_s":0.215368,"scheduling_latency_s":0.215397,"redis_calls":7,"redis_duration_s":0.0008860000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023029,"completed_at":"2026-09-13T10:49:09.690Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002999,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2299gitlab # [ 244.036537] nix-daemon[2758]: accepted connection from pid 3598, user nixbot2300gitlab # [ 244.040633] gitaly[889]: time="2026-09-13T10:49:10.473Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D658FDS82TWCM3QCJBEB7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:40.471" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:10.472" grpc.time_ms=0.55 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2301gitlab # [ 244.061944] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1122302gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses, in 0.16 seconds)2303gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses2304gitlab # [ 245.170558] gitaly[889]: time="2026-09-13T10:49:11.602Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D659KDS8RRTWRFJWZGV537 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:41.600" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:11.601" grpc.time_ms=0.893 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2305gitlab # [ 245.233550] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1312306gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses, in 0.17 seconds)2307gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses2308gitlab # [ 246.363131] gitaly[889]: time="2026-09-13T10:49:12.794Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D65AR48KCYH2T9MR5WRZD1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:42.492" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:12.793" grpc.time_ms=0.882 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2309gitlab # [ 246.391048] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1142310gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses, in 0.16 seconds)2311gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses2312gitlab # [ 247.497128] gitaly[889]: time="2026-09-13T10:49:13.928Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D65BW8S776CJQTFZHJ7FPS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:43.627" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:13.927" grpc.time_ms=0.878 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2313gitlab # [ 247.526773] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 932314gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses, in 0.14 seconds)2315gitlab # [ 248.461239] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:14.892Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"fc4f30750fd1a3c99a48c074","created_at":"2026-09-13T10:49:14.874Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"caf841d7fb19fda6ab51875876322a1e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:14.889Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-fc4f30750fd1a3c99a48c074: start","job_status":"start","queue_duration_s":0.002766,"scheduling_latency_s":0.002816}2316gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses2317gitlab # [ 248.628355] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.060Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"fc4f30750fd1a3c99a48c074","created_at":"2026-09-13T10:49:14.874Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"caf841d7fb19fda6ab51875876322a1e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:14.889Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-fc4f30750fd1a3c99a48c074: done: 0.168294 sec","job_status":"done","queue_duration_s":0.002766,"scheduling_latency_s":0.002816,"redis_calls":13,"redis_duration_s":0.01507,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004954,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003846,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00627,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001152101,"exclusive_lock_hold_duration_s":0.064220732,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.168294,"completed_at":"2026-09-13T10:49:15.060Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033404,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2318gitlab # [ 248.631800] gitaly[889]: time="2026-09-13T10:49:15.063Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=1 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D65CZRPZS80968892ZR557 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:45.057" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:15.058" grpc.time_ms=1.946 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2319gitlab # [ 248.694046] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 802320gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses, in 0.17 seconds)2321gitlab # [ 248.707061] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.139Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"2d281f62469f1eb063839072","created_at":"2026-09-13T10:49:14.938Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99b94c31679d7f2a23084eb697239a60","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:14.955Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-2d281f62469f1eb063839072: start","job_status":"start","queue_duration_s":0.183785,"scheduling_latency_s":0.183813}2322gitlab # [ 248.783266] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.214Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"2d281f62469f1eb063839072","created_at":"2026-09-13T10:49:14.938Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99b94c31679d7f2a23084eb697239a60","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:14.955Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-2d281f62469f1eb063839072: done: 0.075681 sec","job_status":"done","queue_duration_s":0.183785,"scheduling_latency_s":0.183813,"redis_calls":9,"redis_duration_s":0.009479,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001207,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006289,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001983,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.075681,"completed_at":"2026-09-13T10:49:15.214Z","load_balancing_strategy":"primary","db_duration_s":0.038419,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2323gitlab # [ 248.844637] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.276Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ca9756d1ad15a7e4597c4a0c","created_at":"2026-09-13T10:49:14.968Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0bd6f9a467aaa8808f991db50e607c59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-13T10:49:14.982Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ca9756d1ad15a7e4597c4a0c: start","job_status":"start","queue_duration_s":0.294499,"scheduling_latency_s":0.294544}2324gitlab # [ 248.941201] nix-daemon[2758]: accepted connection from pid 3645, user nixbot2325gitlab # [ 248.949853] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.382Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2326gitlab # [ 248.963660] nix-daemon[2758]: accepted connection from pid 3598, user nixbot2327gitlab # [ 248.972660] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.404Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ca9756d1ad15a7e4597c4a0c","created_at":"2026-09-13T10:49:14.968Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0bd6f9a467aaa8808f991db50e607c59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-13T10:49:14.982Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ca9756d1ad15a7e4597c4a0c: done: 0.128359 sec","job_status":"done","queue_duration_s":0.294499,"scheduling_latency_s":0.294544,"redis_calls":9,"redis_duration_s":0.012702,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003108,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006979,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002615,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.073,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.073,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.128359,"completed_at":"2026-09-13T10:49:15.404Z","load_balancing_strategy":"primary","db_duration_s":0.073407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2328gitlab # [ 249.030026] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.461Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e5be8e09b83e767ed3ae532b","created_at":"2026-09-13T10:49:15.016Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b64d9395c7409139c2aff8f080ccb84","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.054Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e5be8e09b83e767ed3ae532b: start","job_status":"start","queue_duration_s":0.40752,"scheduling_latency_s":0.407569}2329gitlab # [ 249.065827] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.498Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2330gitlab # [ 249.078244] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.510Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e5be8e09b83e767ed3ae532b","created_at":"2026-09-13T10:49:15.016Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b64d9395c7409139c2aff8f080ccb84","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.054Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e5be8e09b83e767ed3ae532b: done: 0.048246 sec","job_status":"done","queue_duration_s":0.40752,"scheduling_latency_s":0.407569,"redis_calls":9,"redis_duration_s":0.012369,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001496,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009967,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048246,"completed_at":"2026-09-13T10:49:15.510Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2331gitlab # [ 249.097654] gitaly[889]: time="2026-09-13T10:49:15.530Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D65DEK1ZZWHRYRKTYN7REV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:45.228" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:15.529" grpc.time_ms=0.695 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2332gitlab # [ 249.129520] gitaly[889]: time="2026-09-13T10:49:15.561Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D65DEK1ZZWHRYRKTYN7REV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:49:25.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:15.554" grpc.time_ms=6.917 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2333gitlab # [ 249.130714] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.562Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"3123fe1a0ec9e79d228b5628","created_at":"2026-09-13T10:49:15.135Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8dc16f54b072936f1dac9a8909ec28c9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.143Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-3123fe1a0ec9e79d228b5628: start","job_status":"start","queue_duration_s":0.418352,"scheduling_latency_s":0.418377}2334gitlab # [ 249.187829] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cdbccfdc22fdb0950698128f97da0717df0038d9 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1442335gitlab # [ 249.189126] nixbot[2593]: {"ts": "2026-09-13T10:49:15.621Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cdbccfdc22fdb0950698128f97da0717df0038d9 \"HTTP/1.1 201 Created\""}2336gitlab # [ 249.232582] gitaly[889]: time="2026-09-13T10:49:15.665Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D65DK7Q43JDDZ520SPYK8E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:45.663" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:15.664" grpc.time_ms=0.638 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2337gitlab # [ 249.271865] gitaly[889]: time="2026-09-13T10:49:15.704Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2D65DK7Q43JDDZ520SPYK8E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:49:25.058" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:15.698" grpc.time_ms=5.508 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2338gitlab # [ 249.306264] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cdbccfdc22fdb0950698128f97da0717df0038d9 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1142339gitlab # [ 249.306943] nixbot[2593]: {"ts": "2026-09-13T10:49:15.739Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cdbccfdc22fdb0950698128f97da0717df0038d9 \"HTTP/1.1 201 Created\""}2340gitlab # [ 249.322941] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.755Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"3123fe1a0ec9e79d228b5628","created_at":"2026-09-13T10:49:15.135Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8dc16f54b072936f1dac9a8909ec28c9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.143Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-3123fe1a0ec9e79d228b5628: done: 0.192847 sec","job_status":"done","queue_duration_s":0.418352,"scheduling_latency_s":0.418377,"redis_calls":70,"redis_duration_s":0.062228,"redis_read_bytes":118,"redis_write_bytes":42580,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.00994,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000502,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.050315,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001471,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.079156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.192847,"completed_at":"2026-09-13T10:49:15.755Z","load_balancing_strategy":"primary","db_duration_s":0.019655,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2341gitlab # [ 249.360933] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.793Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e273b5e26385a1872b964cdc","created_at":"2026-09-13T10:49:15.152Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2df614b0c50f43f9f0e52c933fd5148","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.161Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e273b5e26385a1872b964cdc: start","job_status":"start","queue_duration_s":0.632049,"scheduling_latency_s":0.632077}2342gitlab # [ 249.376716] gitaly[889]: time="2026-09-13T10:49:15.809Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D65DQ673XY3FZCH3DCMJYS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:45.807" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:15.808" grpc.time_ms=0.738 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2343gitlab # [ 249.425366] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.857Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e273b5e26385a1872b964cdc","created_at":"2026-09-13T10:49:15.152Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2df614b0c50f43f9f0e52c933fd5148","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.161Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e273b5e26385a1872b964cdc: done: 0.064392 sec","job_status":"done","queue_duration_s":0.632049,"scheduling_latency_s":0.632077,"redis_calls":11,"redis_duration_s":0.00334,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000612,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000858489,"exclusive_lock_hold_duration_s":0.013844776,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.064392,"completed_at":"2026-09-13T10:49:15.857Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012087,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2344gitlab # [ 249.467076] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.898Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c1e7cc99a79b6c7deefa8cb6","created_at":"2026-09-13T10:49:15.187Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d0f3a8dc5e4cf07e6fad1c6cbb16443","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.195Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c1e7cc99a79b6c7deefa8cb6: start","job_status":"start","queue_duration_s":0.70328,"scheduling_latency_s":0.703302}2345gitlab # [ 249.482082] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.914Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2346gitlab # [ 249.490785] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.922Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c1e7cc99a79b6c7deefa8cb6","created_at":"2026-09-13T10:49:15.187Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d0f3a8dc5e4cf07e6fad1c6cbb16443","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.195Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c1e7cc99a79b6c7deefa8cb6: done: 0.024227 sec","job_status":"done","queue_duration_s":0.70328,"scheduling_latency_s":0.703302,"redis_calls":9,"redis_duration_s":0.002673,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000553,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001555,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000565,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024227,"completed_at":"2026-09-13T10:49:15.922Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000705,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2347gitlab # [ 249.494201] gitaly[889]: time="2026-09-13T10:49:15.926Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2D65DQ673XY3FZCH3DCMJYS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T10:49:25.272" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T10:49:15.912" grpc.time_ms=13.436 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2348gitlab # [ 249.542922] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:15.974Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"e15f80284a2272b2eecd5987","created_at":"2026-09-13T10:49:15.197Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1575a56c169b4cd825a9b817f75ab0d0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.205Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-e15f80284a2272b2eecd5987: start","job_status":"start","queue_duration_s":0.769717,"scheduling_latency_s":0.769763}2349gitlab # [ 249.607066] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:16 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cdbccfdc22fdb0950698128f97da0717df0038d9 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2882350gitlab # [ 249.611292] nixbot[2593]: {"ts": "2026-09-13T10:49:16.043Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cdbccfdc22fdb0950698128f97da0717df0038d9 \"HTTP/1.1 201 Created\""}2351gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses2352gitlab # [ 249.661542] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:16.093Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"e15f80284a2272b2eecd5987","created_at":"2026-09-13T10:49:15.197Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1575a56c169b4cd825a9b817f75ab0d0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.205Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-e15f80284a2272b2eecd5987: done: 0.118961 sec","job_status":"done","queue_duration_s":0.769717,"scheduling_latency_s":0.769763,"redis_calls":12,"redis_duration_s":0.003093,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000494,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001383,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001216,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000706235,"exclusive_lock_hold_duration_s":0.083698069,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.118961,"completed_at":"2026-09-13T10:49:16.093Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005415,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}2353gitlab # [ 249.721097] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:16.152Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"a919746fe1d20ed8692a7131","created_at":"2026-09-13T10:49:15.215Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a0e0b1098b22f6dee56ccbf1c4bf6a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.296Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-a919746fe1d20ed8692a7131: start","job_status":"start","queue_duration_s":0.855821,"scheduling_latency_s":0.855852}2354gitlab # [ 249.736719] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:16.168Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"a919746fe1d20ed8692a7131","created_at":"2026-09-13T10:49:15.215Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a0e0b1098b22f6dee56ccbf1c4bf6a8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.296Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-a919746fe1d20ed8692a7131: done: 0.017011 sec","job_status":"done","queue_duration_s":0.855821,"scheduling_latency_s":0.855852,"redis_calls":11,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":9,"redis_write_bytes":1386,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000516,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000307,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017011,"completed_at":"2026-09-13T10:49:16.168Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001369,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2355gitlab # [ 249.738616] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:16.171Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"21e1e07ea234794c86efa38e","created_at":"2026-09-13T10:49:15.374Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a5cd3dfbfbec4d52282b9a8bbeaef87","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.383Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-21e1e07ea234794c86efa38e: start","job_status":"start","queue_duration_s":0.787816,"scheduling_latency_s":0.78783}2356gitlab # [ 249.758416] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:16.190Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2357gitlab # [ 249.765696] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:16.197Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"21e1e07ea234794c86efa38e","created_at":"2026-09-13T10:49:15.374Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a5cd3dfbfbec4d52282b9a8bbeaef87","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.383Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-21e1e07ea234794c86efa38e: done: 0.026884 sec","job_status":"done","queue_duration_s":0.787816,"scheduling_latency_s":0.78783,"redis_calls":9,"redis_duration_s":0.001765,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000373,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000377,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026884,"completed_at":"2026-09-13T10:49:16.197Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001526,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2358gitlab # [ 249.821997] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:16.198Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a0bb6e6be4788430cc972192","created_at":"2026-09-13T10:49:15.395Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"87bf69d56b8d6749e47cb2525a852aae","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.460Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a0bb6e6be4788430cc972192: start","job_status":"start","queue_duration_s":0.738353,"scheduling_latency_s":0.738367}2359gitlab # [ 249.822763] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:16.210Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a0bb6e6be4788430cc972192","created_at":"2026-09-13T10:49:15.395Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"87bf69d56b8d6749e47cb2525a852aae","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.460Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a0bb6e6be4788430cc972192: done: 0.011636 sec","job_status":"done","queue_duration_s":0.738353,"scheduling_latency_s":0.738367,"redis_calls":9,"redis_duration_s":0.001764,"redis_read_bytes":7,"redis_write_bytes":1192,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000405,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011636,"completed_at":"2026-09-13T10:49:16.210Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2360gitlab # [ 249.838275] sidekiq-cluster[2474]: {"severity":"INFO","time":"2026-09-13T10:49:16.211Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"10af168842039309db291010","created_at":"2026-09-13T10:49:15.490Z","trace_propagation_headers":{"sentry-trace":"29c5a297763344d5bb824b0c793358df-b1d75c66ae634343","baggage":"sentry-trace_id=29c5a297763344d5bb824b0c793358df,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16f463cdb686771813ea07e2894cde11","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-13T10:49:15.497Z","job_size_bytes":2,"pid":2474,"sidekiq_tid":"m7zy","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-10af168842039309db291010: start","job_status":"start","queue_duration_s":0.714438,"scheduling_latency_s":0.714451}2361gitlab # [ 249.939765] gitaly[889]: time="2026-09-13T10:49:16.371Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2D65E9HN5PQ6ZP7G8XVXPTY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T10:49:46.370" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T10:49:16.371" grpc.time_ms=0.411 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2362gitlab # [ 249.957265] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/09/13:10:49:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 512363gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/cdbccfdc22fdb0950698128f97da0717df0038d9/statuses, in 0.26 seconds)2364(finished: subtest: eval and build post commit statuses, in 7.32 seconds)2365(finished: run the VM test script, in 299.26 seconds)2366test script finished in 299.29s2367cleanup2368kill QemuMachine (pid 46)2369gitlab # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2370(finished: cleanup, in 1.35 seconds)2371additionally exposed symbols:2372 gitlab,2373 vlan1,2374 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2375[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-13T10:48:21.936Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2376[]2377[]2378[]2379[]2380[]2381[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'cdbccfdc22fdb0950698128f97da0717df0038d9', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-13T10:49:08.577947Z', 'started_at': '2026-09-13T10:49:08.944014Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2382[{'id': 5, 'sha': 'cdbccfdc22fdb0950698128f97da0717df0038d9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-13T10:49:08.881Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2383[{'id': 5, 'sha': 'cdbccfdc22fdb0950698128f97da0717df0038d9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-13T10:49:08.881Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2384[{'id': 5, 'sha': 'cdbccfdc22fdb0950698128f97da0717df0038d9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-13T10:49:08.881Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2385[{'id': 5, 'sha': 'cdbccfdc22fdb0950698128f97da0717df0038d9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-13T10:49:08.881Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2386[{'id': 5, 'sha': 'cdbccfdc22fdb0950698128f97da0717df0038d9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-13T10:49:08.881Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2387[{'id': 5, 'sha': 'cdbccfdc22fdb0950698128f97da0717df0038d9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-13T10:49:08.881Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2388[{'id': 5, 'sha': 'cdbccfdc22fdb0950698128f97da0717df0038d9', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 6s (1 warning)', 'created_at': '2026-09-13T10:49:08.881Z', 'started_at': None, 'finished_at': '2026-09-13T10:49:15.593Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'cdbccfdc22fdb0950698128f97da0717df0038d9', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-09-13T10:49:15.718Z', 'started_at': None, 'finished_at': '2026-09-13T10:49:16.010Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]